返回信息流高中同学问我怎么办,说有点急,我和她说明天早上回复她。。
问题是这样的:http://shuju.wangdaizhijia.com/archives-60.html
像这样的网站,有一些图表,想把该网站所有的这些图表背后的数据抓下来。
我知道原理,可是不会web啊。。 大约是不断的 访问+抓取。
不是这个方向的,我就能看懂最简单的html,在一点点看+学,很虚。。。
求高手指点我一下,该怎么弄。。。
我现在知道它应该是每次点一个选项,就通过web传来数据,然后通过js(?我猜的,不知哪个)画图。
能帮我分析下吗?比如哪个是画图的,哪个是数据。。any other help ok...
Thanks!
这是一条镜像帖。来源:北邮人论坛 / www-technology / #29005同步于 2015/1/16
该镜像源已超过 30 天没有更新,可能在源站已被删除。
WWWTechnology机器人发帖
web信息抓取求情谊帮助
mathlove
2015/1/16镜像同步14 回复
订阅后,新回复会通过你的通知中心匿名送达。
9 条回复
我暂时搞不定啦,谁教教我呗。
我知道图
<div class="mb10" id="archivesChart" style="height:350px;width:980px" ></div>
<div class="mb10" id="archivesChart2" style="height:350px;width:980px;display:none;"></div>
以及canvas有关。 但是我还是不知道它到底是在哪个代码里1. 接受了数据 2. 用数据去画画的
不猜啦,因为还有许多些细节没搞懂。。 高手能帮我看看嘛 。。
开一下console 要啥有啥
【 在 mathlove 的大作中提到: 】
: 高中同学问我怎么办,说有点急,我和她说明天早上回复她。。
: 问题是这样的:http://shuju.wangdaizhijia.com/archives-60.html
: 像这样的网站,有一些图表,想把该网站所有的这些图表背后的数据抓下来。
: ...................
这种图表一般都有框架,在手机上看的时候还以为是highcharts框架,whatever,
框架的好处就是只需要给他数据格式,然后框架就可以自己渲染绘制图表了,同样的,我们可以根据请求url得到他的数据,然后就达到你的需求了
图是楼上的图
firebug 或者chrome分析下请求的数据就知道了,无非就是请求参数的区别,
柱状图请求url是http://shuju.wangdaizhijia.com/archives-chart.html?platId=60&type1=1&type2=999&status=0
返回数据是
{"obj1":[1052.13,288.48,345.11,567.14,538.07,379.29,479.02,521.26,201.8,824.19,846.1,691.61,721.99,1400.86,53.05,0,56.06,855.28,1358.03,171.63,144.87,809.07,1048.74,374.88,183.08,275.55,225.37,299.12,1993.9,346.83,179.44,504.85,2508.83,200.31,519.95,505.19,333.31,117.78,755.21,358.32,251.68,1440.19,593.25,1130.13,112.79,1074.04,361.63,404.96,1177.43,433.35,451.51,417.19,640.94,197.48,285.8,914.56,250.54,176.39,204.79,596.02,483.75,476.92,279.51,654.66,329.28,632.4,10457.98,520.4,7155.73,686.09,5765.63,1362.34,2222.88,1612.87,2574.28,2510.82,2579.08,1480.84,271.65,233,303.87,893.01,1161.67,341.5,528.51,430.53,407.94,1263.25,589.8,275.59,800.61,566.25,244.02,236.94,615.07,637.13,835.98,1711.28,465.79,357.57,443.53,12826.26,2762.45,2025.73,1591.8,431.99,429.9,783.04,1243.82,2340.11,2196.52,3816.75,9192.85,671.4,552.29,4422.25,4305.58,3823.72,634.88,740.55,613.99,367.24,5102.24,1514.02,1747.84,876.76,1102.82,606.48,645.74,576.49,509.92,707.9,3344.41,949.17,303.53,1033.7,1750.4,7273.14,2053.38,799.1,865.63,629.45,556.59,1223.38,805.28,669.33,3635.48,2341.11,2373.69,719.01,4053.08,4595.95,1044.22,1188.3,783.42,471.89,690.24,2921.44,1138.08,1321.27,665.88,1352.93,779.92,527.19,891.42,421.43,700.06,879.26,1009.26,1543.7,7915.53,891.54,2956.29,2416.69,3322.03,5334.47,3319.02,14026.5,1844.77,3064.25,2919.13,2965.79,5666.32,5375.49,5870.94,15182.54,2536.51,1855.85,3011.8,12430.57,2793.91,3584.78,3832.64,4151.79,4575.28,4376.45,3537.73,1230.63,1201.68,1903.89,1788.75,1919.32,1889.49,1817.47,1585.35,3940.18,11176.35,5343.46,5896.13,4579.89,3200.95,3700.97,7056.53,16114.86,3631.8,10954.07,3716.34,4237.57,2092.38,1449.38,5262.47,3315.79,3437.83,2058.01,4555.38,2760.26,2687.95,3890.02,4261.55,12394.4,2933.22,9971.83,1536.69,3071.24,4731.85,5285.03,8797.66,3032.75,3386.59,2907.72,3049.21,9994.44,9246.94,4112.53,6879.13,5856.16,3684.9,3911.74,5983.23,7671.12,7136.13,5092.02,5800.51,5477.68,2046.07,7717.98,7248.64,10067.6,5625.44,5103.07,5143.6,6126.11,6657.08,4971.58,6083.26,8867.38,5190.53,5838.66,4575.49,3632.58,5856.72,15674.7,8377.1,7757.99,4558.75,5939.89,13456.22,11174.8,10030.74,13985.85,9212.64,5039.34,1401.26,14602.15,16684.49,9465.13,19481.38,5005.78,5561.1,6454.75,13906.65,8611.26,9217.64,5780.02,6772.43,4566.46,4855.75,8915.99,55370.08,6269.28,7339.44,6434.89,5812.57,7053.08,7269.63,10902.68,7464.39,7797.04,9485.29,7461.76,6623.46,8603.54,7602.16,12267.73,6593.72,9691.59,6041.33,10967.53,6814.75,5678.27,8623.32,15158.41,14115.98,6171.61,3347.51,6889.88,6455.93,6857.53,8936.55,17756.82,4563.33,5988.78,12657.86,7017.86,13235.69,8083.75,10721.59,7426.07,6686.38,9696,9428.26,8637.04,17356.77,12451.74,10825.39,6834.68,9171.29,9514.95,9385.86,8.31,11638.97,8740.44,10921.87,10705.66,12453.79,12982.93,9729.4,10868.74,8551.57,10085.64,12446.1,13369.42,12484.15,9662.03,3386.81],"platId":"60","status":0,"titles":["成交量"],"type":0,"type1":1,"type2":999,"types":["bar"],"units":["万元"],"x":["2014-01-17","2014-01-18","2014-01-19","2014-01-20","2014-01-21","2014-01-22","2014-01-23","2014-01-24","2014-01-25","2014-01-26","2014-01-27","2014-01-28","2014-01-29","2014-01-30","2014-01-31","2014-02-01","2014-02-02","2014-02-03","2014-02-04","2014-02-05","2014-02-06","2014-02-07","2014-02-08","2014-02-09","2014-02-10","2014-02-11","2014-02-12","2014-02-13","2014-02-14","2014-02-15","2014-02-16","2014-02-17","2014-02-18","2014-02-19","2014-02-20","2014-02-21","2014-02-22","2014-02-23","2014-02-24","2014-02-25","2014-02-26","2014-02-27","2014-02-28","2014-03-01","2014-03-02","2014-03-03","2014-03-04","2014-03-05","2014-03-06","2014-03-07","2014-03-08","2014-03-09","2014-03-10","2014-03-11","2014-03-12","2014-03-13","2014-03-14","2014-03-15","2014-03-16","2014-03-17","2014-03-18","2014-03-19","2014-03-20","2014-03-21","2014-03-22","2014-03-23","2014-03-24","2014-03-25","2014-03-26","2014-03-27","2014-03-28","2014-03-29","2014-03-30","2014-03-31","2014-04-01","2014-04-02","2014-04-03","2014-04-04","2014-04-05","2014-04-06","2014-04-07","2014-04-08","2014-04-09","2014-04-10","2014-04-11","2014-04-12","2014-04-13","2014-04-14","2014-04-15","2014-04-16","2014-04-17","2014-04-18","2014-04-19","2014-04-20","2014-04-21","2014-04-22","2014-04-23","2014-04-24","2014-04-25","2014-04-26","2014-04-27","2014-04-28","2014-04-29","2014-04-30","2014-05-01","2014-05-02","2014-05-03","2014-05-04","2014-05-05","2014-05-06","2014-05-07","2014-05-08","2014-05-09","2014-05-10","2014-05-11","2014-05-12","2014-05-13","2014-05-14","2014-05-15","2014-05-16","2014-05-17","2014-05-18","2014-05-19","2014-05-20","2014-05-21","2014-05-22","2014-05-23","2014-05-24","2014-05-25","2014-05-26","2014-05-27","2014-05-28","2014-05-29","2014-05-30","2014-05-31","2014-06-01","2014-06-02","2014-06-03","2014-06-04","2014-06-05","2014-06-06","2014-06-07","2014-06-08","2014-06-09","2014-06-10","2014-06-11","2014-06-12","2014-06-13","2014-06-14","2014-06-15","2014-06-16","2014-06-17","2014-06-18","2014-06-19","2014-06-20","2014-06-21","2014-06-22","2014-06-23","2014-06-24","2014-06-25","2014-06-26","2014-06-27","2014-06-28","2014-06-29","2014-06-30","2014-07-01","2014-07-02","2014-07-03","2014-07-04","2014-07-05","2014-07-06","2014-07-07","2014-07-08","2014-07-09","2014-07-10","2014-07-11","2014-07-12","2014-07-13","2014-07-14","2014-07-15","2014-07-16","2014-07-17","2014-07-18","2014-07-19","2014-07-20","2014-07-21","2014-07-22","2014-07-23","2014-07-24","2014-07-25","2014-07-26","2014-07-27","2014-07-28","2014-07-29","2014-07-30","2014-07-31","2014-08-01","2014-08-02","2014-08-03","2014-08-04","2014-08-05","2014-08-06","2014-08-07","2014-08-08","2014-08-09","2014-08-10","2014-08-11","2014-08-12","2014-08-13","2014-08-14","2014-08-15","2014-08-16","2014-08-17","2014-08-18","2014-08-19","2014-08-20","2014-08-21","2014-08-22","2014-08-23","2014-08-24","2014-08-25","2014-08-26","2014-08-27","2014-08-28","2014-08-29","2014-08-30","2014-08-31","2014-09-01","2014-09-02","2014-09-03","2014-09-04","2014-09-05","2014-09-06","2014-09-07","2014-09-08","2014-09-09","2014-09-10","2014-09-11","2014-09-12","2014-09-13","2014-09-14","2014-09-15","2014-09-16","2014-09-17","2014-09-18","2014-09-19","2014-09-20","2014-09-21","2014-09-22","2014-09-23","2014-09-24","2014-09-25","2014-09-26","2014-09-27","2014-09-28","2014-09-29","2014-09-30","2014-10-01","2014-10-02","2014-10-03","2014-10-04","2014-10-05","2014-10-06","2014-10-07","2014-10-08","2014-10-09","2014-10-10","2014-10-11","2014-10-12","2014-10-13","2014-10-14","2014-10-15","2014-10-16","2014-10-17","2014-10-18","2014-10-19","2014-10-20","2014-10-21","2014-10-22","2014-10-23","2014-10-24","2014-10-25","2014-10-26","2014-10-27","2014-10-28","2014-10-29","2014-10-30","2014-10-31","2014-11-01","2014-11-02","2014-11-03","2014-11-04","2014-11-05","2014-11-06","2014-11-07","2014-11-08","2014-11-09","2014-11-10","2014-11-11","2014-11-12","2014-11-13","2014-11-14","2014-11-15","2014-11-16","2014-11-17","2014-11-18","2014-11-19","2014-11-20","2014-11-21","2014-11-22","2014-11-23","2014-11-24","2014-11-25","2014-11-26","2014-11-27","2014-11-28","2014-11-29","2014-11-30","2014-12-01","2014-12-02","2014-12-03","2014-12-04","2014-12-05","2014-12-06","2014-12-07","2014-12-08","2014-12-09","2014-12-10","2014-12-11","2014-12-12","2014-12-13","2014-12-14","2014-12-15","2014-12-16","2014-12-17","2014-12-18","2014-12-19","2014-12-20","2014-12-21","2014-12-22","2014-12-23","2014-12-24","2014-12-25","2014-12-26","2014-12-27","2014-12-28","2014-12-29","2014-12-30","2014-12-31","2015-01-01","2015-01-02","2015-01-03","2015-01-04","2015-01-05","2015-01-06","2015-01-07","2015-01-08","2015-01-09","2015-01-10","2015-01-11","2015-01-12","2015-01-13","2015-01-14","2015-01-15","2015-01-16"]}
饼状图请求url是http://shuju.wangdaizhijia.com/archives-pie.html?platId=60
返回数据是
{"pie1":{"data":[{"name":"信用标","value":179},{"name":"净值标","value":150631},{"name":"快借标","value":199},{"name":"推荐标","value":33},{"name":"秒标","value":38336},{"name":"资产标","value":6160}],"title":["信用标","净值标","快借标","推荐标","秒标","资产标"]},"pie2":{"data":[{"name":"1月标","value":182685},{"name":"2月标","value":527},{"name":"3月标","value":2099},{"name":"4-6月标","value":1555},{"name":"6月以上标","value":961},{"name":"天标","value":7711}],"title":["1月标","2月标","3月标","4-6月标","6月以上标","天标"]},"pie3":{"data":[{"name":"0-10万","value":181655},{"name":"10-100万","value":13445},{"name":"100-1000万","value":434},{"name":"1000万以上","value":4}],"title":["0-10万","10-100万","100-1000万","1000万以上"]}}
然后再分析以上json数据,搞成符合你自己的形式就可以了