好久不见，各位小伙伴们！嗐，春节真滴快啊！祝大家新年快乐！
书山有路勤为径，学海无涯苦作舟！又得开始愉快滴学习了！
小夜斗今天给大家伙分享一期干货，芜湖起飞！
Js逆向网易云爬取评论并利用sNownpl进行情感分析
一：逆向破解网易云参数抓取评论信息网易云PC端url: https://music.163.com/#/song?id=1817702136
从xhr里面找一下子就能找到，看下面截图:
第一个办法: 分析网页源码，找到生产参数所需要的方法，利用网页自身的代码拿到两个参数即可！(一般是分析JavaScript代码，俗称Js逆向)
第二个办法: 了解这个网页Js代码如何生产的这两个参数，并利用python仿写Js代码所具有的功能，自己构造俩个参数！
我们先从一大堆请求中找到带有 params、encSecKey参数文件
按下ctrl + F 搜索params， 找到箭头所指的2文件！
点击源代码进入Js文件，并点击格式化Js代码，格式化后如图二
图一:
图二：格式化后输入params找到其位置，一步步分析如何生产！
好啦，到了最关键的地步，逆向分析这俩参数是如何加密产生的！
第一步, 找到生成这两个参数的Js代码，如下所示:
把Js代码扣下来看:
e5j.data = j5o.cr6l({ params: bWv4z.encText, encSecKey: bWv4z.encSecKey }) }12345看起来是’bWv4z’这个对象调用encText和encSecKey这两个方法分别生产的params和encSecKey
第二步: 然后我们找找 bWv4z 对象是怎么生成的
var bWv4z = window.asrsea(JsON.stringify(i5n), bsK6E(["流泪", "强"]), bsK6E(XR1x.md), bsK6E(["爱心", "女孩", "惊恐", "大笑"]));1
一个window.asrsea对象中传入4个参数生成bWv4z对象，其实这个时候可以先分析传入的四个参数是什么，或者先找到window.asrsea对象是如何生产的，这里我们先看后者
第三步: window.asrsea是如何产生的
通过上图我们知道，这个对象是由 d 产生的，一开始小夜斗也不知道d是个什么东西，通过搜索后发现，d是一个方法, 如下图所示:
这我们就知道了，
window.asrsea相当于是d方法赋值(不太懂Js代码，小夜斗自己是这么理解的)，然后window.asrsea传入的四个参数就相当于调用d中需要传入的四个参数！让我们打个断点看看，按下f5刷新页面，看看d中传入的四个参数！
d函数中四个参数如下图所示:
d: "{"csrf_token":"d4339865ec133c9a7d77a25389bc0265"}"e: "010001"f: "00e0b509f6259df8642dbc35662901477df22677ec152b5ff68ace615bb7b725152b3ab17a876aea8a5aa76d2e417629ec4ee341f56135fccf695280104e0312ecbda92557c93870114af6c9d05c4f7f0c3685b7a46bee255932575cce10b424d813cfe4875d3e82047b97ddef52741d546b8e289dc6935b3ece0462db0a22b8e7"g: "0CoJUm6Qyw8W8jud"1234我们再来看一下window.asrsea 其中四个参数分别是上述: d e f g
var bWv4z = window.asrsea(JsON.stringify(i5n), bsK6E(["流泪", "强"]), bsK6E(XR1x.md), bsK6E(["爱心", "女孩", "惊恐", "大笑"]));1
其中呢我们看第一个参数JsON.stringify(i5n)对应的是d，大概就是将i5n转化为Json格式吧，我们打个断点看看最后i5n是什么！
i5n = {csrf_token: "d4339865ec133c9a7d77a25389bc0265"}// 上下对比发现JsON.stringify(i5n)是将i5n转化为Json格式d: "{"csrf_token":"d4339865ec133c9a7d77a25389bc0265"}"123小夜斗换了一首歌发现，上面这四个参数都是固定的:
url: https://music.163.com/#/song?id=1820887593
d: "{"csrf_token":"d4339865ec133c9a7d77a25389bc0265"}"e: "010001"f: "00e0b509f6259df8642dbc35662901477df22677ec152b5ff68ace615bb7b725152b3ab17a876aea8a5aa76d2e417629ec4ee341f56135fccf695280104e0312ecbda92557c93870114af6c9d05c4f7f0c3685b7a46bee255932575cce10b424d813cfe4875d3e82047b97ddef52741d546b8e289dc6935b3ece0462db0a22b8e7"g: "0CoJUm6Qyw8W8jud"1234重新打断点，选择第二页后有了新的发现！
注意，打第二页断点的时候，要先打断点，f5刷新后会跳转到第一页，之个时候你在选择第二页，就会加载参数内容了！
d: "{"rID":"R_SO_4_1817702136","threadID":"R_SO_4_1817702136","pageNo":"2","pageSize":"20","cursor":"1613900247044","offset":"40","orderType":"1","csrf_token":"d4339865ec133c9a7d77a25389bc0265"}"e: "010001"f: "00e0b509f6259df8642dbc35662901477df22677ec152b5ff68ace615bb7b725152b3ab17a876aea8a5aa76d2e417629ec4ee341f56135fccf695280104e0312ecbda92557c93870114af6c9d05c4f7f0c3685b7a46bee255932575cce10b424d813cfe4875d3e82047b97ddef52741d546b8e289dc6935b3ece0462db0a22b8e7"g: "0CoJUm6Qyw8W8jud"1234让我们看看d: 里面几个参数的含义
“rID”:“R_SO_4_1817702136” 后面这个数字是网页url后面的ID (根据ID变换)
“threadID”:“R_SO_4_1817702136” 同上 （根据ID 变换)
“pageNo”:“2” 页码数 （变量）
“pageSize”:“20” 每一页评论的数量 常量
“cursor”:“1613900247044” 应该是时间戳13位 (变量)
“offset”:“40” 偏移量 (页码数 * 20) (变量)
“orderType”:“1” 估计是啥类型是个常量
“csrf_token”:“d4339865ec133c9a7d77a25389bc0265”} 同样是个常量
好勒，了解了四个参数后我们可以看看d函数内部到底做了啥事情!
第四步: d函数内部到底做了啥事情!
把Js代码扣下来如下所示:
function d(d, e, f, g) { var h = {} , i = a(16); return h.encText = b(d, g), h.encText = b(h.encText, i), h.encSecKey = c(i, e, f), h }12345678定义了一个字典h, 变量i的值是a(16)
了解后发现，a、b、c、d都是函数
首先看看函数a内部:
function a(a) { var d, e, b = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMnopQRSTUVWXYZ0123456789", c = ""; for (d = 0; a > d; d += 1) e = Math.random() * b.length, e = Math.floor(e), c += b.charat(e); return c }12345678乍一看，我滴天这是啥子东西，别急我们用pycharm来执行这个Js代码即可知道返回的c是个什么东西，即可倒推这个函数的功能得到i
因为将网页源码的Js代码copy到pycharm里面执行会因为某些换行符报错，小夜斗就将Js代码copy到了下面这个软件: 好像是前端用滴！
pycharm中执行Js文件的代码如下:
pip install PyExecJs # 安装执行Js代码的库1
#-*- Coding: utf-8 -*-# Todo: 正确的Js代码里面(网页上copy的有换行符)# 解决办法，先将代码copy到HBUILD里面, 然后执行Js代码import execJsimport requestsJs = open('./analysis_3.Js', 'r', enCoding='utf8').read()aim = execJs.compile(Js) # 生产Js对象data = aim.call('example') # 调用相应方法print(data) # 输出结果1234567891011结果如下所示: 每次生产不一样的长度为16的字符串！估计就是从a函数那个很长的字符串中随机选择16个字符串然后拼接在一起吧，小夜斗猜测这就是a函数的功能！
结果2如下图所示:
下面是第一次为了获得变量i值扣下来的Js代码（analysis_3.Js）:
/*d: "{"rID":"R_SO_4_1817702136","threadID":"R_SO_4_1817702136","pageNo":"2","pageSize":"20","cursor":"1613900247044","offset":"40","orderType":"1","csrf_token":"d4339865ec133c9a7d77a25389bc0265"}"e: "010001"f: "00e0b509f6259df8642dbc35662901477df22677ec152b5ff68ace615bb7b725152b3ab17a876aea8a5aa76d2e417629ec4ee341f56135fccf695280104e0312ecbda92557c93870114af6c9d05c4f7f0c3685b7a46bee255932575cce10b424d813cfe4875d3e82047b97ddef52741d546b8e289dc6935b3ece0462db0a22b8e7"g: "0CoJUm6Qyw8W8jud" */function d(d, e, f, g) { var h = {} , i = a(16); return h.encText = b(d, g), // 执行到此已经获取到变量i的值 h.encText = b(h.encText, i), h.encSecKey = c(i, e, f), h } function a(a) { var d, e, b = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMnopQRSTUVWXYZ0123456789", c = ""; for (d = 0; a > d; d += 1) e = Math.random() * b.length, e = Math.floor(e), c += b.charat(e); return c } function example(){ i = a(16); return i; }1234567891011121314151617181920212223242526272829303132然后我们再回到d函数内部，执行代码h.encText = b(d, g)，即我们需要调用b函数，其中两个参数分别为d，g，这俩参数我们都能构造的知，问题不大！继续扣Js代码!
先将函数b扣下来看看:
/*d: "{"rID":"R_SO_4_1817702136","threadID":"R_SO_4_1817702136","pageNo":"2","pageSize":"20","cursor":"1613900247044","offset":"40","orderType":"1","csrf_token":"d4339865ec133c9a7d77a25389bc0265"}"e: "010001"f: "00e0b509f6259df8642dbc35662901477df22677ec152b5ff68ace615bb7b725152b3ab17a876aea8a5aa76d2e417629ec4ee341f56135fccf695280104e0312ecbda92557c93870114af6c9d05c4f7f0c3685b7a46bee255932575cce10b424d813cfe4875d3e82047b97ddef52741d546b8e289dc6935b3ece0462db0a22b8e7"g: "0CoJUm6Qyw8W8jud" */function d(d, e, f, g) { var h = {} , i = a(16); return h.encText = b(d, g), // 执行到此已经获取到变量i的值 h.encText = b(h.encText, i), h.encSecKey = c(i, e, f), h } function a(a) { var d, e, b = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMnopQRSTUVWXYZ0123456789", c = ""; for (d = 0; a > d; d += 1) e = Math.random() * b.length, e = Math.floor(e), c += b.charat(e); return c }function b(a, b) { var c = CryptoJs.enc.Utf8.parse(b) , d = CryptoJs.enc.Utf8.parse("0102030405060708") , e = CryptoJs.enc.Utf8.parse(a) , f = CryptoJs.AES.encrypt(e, c, { iv: d, mode: CryptoJs.mode.CBC }); return f.toString() } function example(){ i = a(16); h = {} h.encText = b({"rID":"R_SO_4_1817702136","threadID":"R_SO_4_1817702136","pageNo":"2","pageSize":"20","cursor":"1613900247044","offset":"40","orderType":"1","csrf_token":"d4339865ec133c9a7d77a25389bc0265"}, "0CoJUm6Qyw8W8jud") return h;}123456789101112131415161718192021222324252627282930313233343536373839404142434445从Pycharm执行这个Js文件发现报错: CryptoJs is not defined
就是Js代码中少了**CryptoJs **这个函数功能，问题不大我们从Js源码中扣下来即可！就搜这个函数名字，然后找到看起来像这个函数复制下来即可！不难！
第三次扣下来的Js代码如下所示:
/*d: "{"rID":"R_SO_4_1817702136","threadID":"R_SO_4_1817702136","pageNo":"2","pageSize":"20","cursor":"1613900247044","offset":"40","orderType":"1","csrf_token":"d4339865ec133c9a7d77a25389bc0265"}"e: "010001"f: "00e0b509f6259df8642dbc35662901477df22677ec152b5ff68ace615bb7b725152b3ab17a876aea8a5aa76d2e417629ec4ee341f56135fccf695280104e0312ecbda92557c93870114af6c9d05c4f7f0c3685b7a46bee255932575cce10b424d813cfe4875d3e82047b97ddef52741d546b8e289dc6935b3ece0462db0a22b8e7"g: "0CoJUm6Qyw8W8jud" */function d(d, e, f, g) { var h = {} , i = a(16); return h.encText = b(d, g), // 执行到此已经获取到变量i的值 h.encText = b(h.encText, i), h.encSecKey = c(i, e, f), h } function a(a) { var d, e, b = "abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMnopQRSTUVWXYZ0123456789", c = ""; for (d = 0; a > d; d += 1) e = Math.random() * b.length, e = Math.floor(e), c += b.charat(e); return c }function b(a, b) { var c = CryptoJs.enc.Utf8.parse(b) , d = CryptoJs.enc.Utf8.parse("0102030405060708") , e = CryptoJs.enc.Utf8.parse(a) , f = CryptoJs.AES.encrypt(e, c, { iv: d, mode: CryptoJs.mode.CBC }); return f.toString() }var CryptoJs = CryptoJs || function(u, p) { var d = {} , l = d.lib = {} , s = function() {} , t = l.Base = { extend: function(a) { s.prototype = this; var c = new s; a && c.mixIn(a); c.hasOwnProperty("init") || (c.init = function() { c.$super.init.apply(this, arguments) } ); c.init.prototype = c; c.$super = this; return c }, create: function() { var a = this.extend(); a.init.apply(a, arguments); return a }, init: function() {}, mixIn: function(a) { for (var c in a) a.hasOwnProperty(c) && (this[c] = a[c]); a.hasOwnProperty("toString") && (this.toString = a.toString) }, clone: function() { return this.init.prototype.extend(this) } } , r = l.WordArray = t.extend({ init: function(a, c) { a = this.words = a || []; this.sigBytes = c != p ? c : 4 * a.length }, toString: function(a) { return (a || v).stringify(this) }, concat: function(a) { var c = this.words , e = a.words , j = this.sigBytes; a = a.sigBytes; this.clamp(); if (j % 4) for (var k = 0; k < a; k++) c[j + k >>> 2] |= (e[k >>> 2] >>> 24 - 8 * (k % 4) & 255) << 24 - 8 * ((j + k) % 4); else if (65535 < e.length) for (k = 0; k < a; k += 4) c[j + k >>> 2] = e[k >>> 2]; else c.push.apply(c, e); this.sigBytes += a; return this }, clamp: function() { var a = this.words , c = this.sigBytes; a[c >>> 2] &= 4294967295 << 32 - 8 * (c % 4); a.length = u.ceil(c / 4) }, clone: function() { var a = t.clone.call(this); a.words = this.words.slice(0); return a }, random: function(a) { for (var c = [], e = 0; e < a; e += 4) c.push(4294967296 * u.random() | 0); return new r.init(c,a) } }) , w = d.enc = {} , v = w.Hex = { stringify: function(a) { var c = a.words; a = a.sigBytes; for (var e = [], j = 0; j < a; j++) { var k = c[j >>> 2] >>> 24 - 8 * (j % 4) & 255; e.push((k >>> 4).toString(16)); e.push((k & 15).toString(16)) } return e.join("") }, parse: function(a) { for (var c = a.length, e = [], j = 0; j < c; j += 2) e[j >>> 3] |= parseInt(a.substr(j, 2), 16) << 24 - 4 * (j % 8); return new r.init(e,c / 2) } } , b = w.latin1 = { stringify: function(a) { var c = a.words; a = a.sigBytes; for (var e = [], j = 0; j < a; j++) e.push(String.fromCharCode(c[j >>> 2] >>> 24 - 8 * (j % 4) & 255)); return e.join("") }, parse: function(a) { for (var c = a.length, e = [], j = 0; j < c; j++) e[j >>> 2] |= (a.charCodeAt(j) & 255) << 24 - 8 * (j % 4); return new r.init(e,c) } } , x = w.Utf8 = { stringify: function(a) { try { return decodeURIComponent(escape(b.stringify(a))) } catch (c) { throw Error("Malformed UTF-8 data") } }, parse: function(a) { return b.parse(unescape(encodeURIComponent(a))) } } , q = l.BufferedBlockAlgorithm = t.extend({ reset: function() { this.i5n = new r.init; this.sN2x = 0 }, vE3x: function(a) { "string" == typeof a && (a = x.parse(a)); this.i5n.concat(a); this.sN2x += a.sigBytes }, lg9X: function(a) { var c = this.i5n , e = c.words , j = c.sigBytes , k = this.blockSize , b = j / (4 * k) , b = a ? u.ceil(b) : u.max((b | 0) - this.GX6R, 0); a = b * k; j = u.min(4 * a, j); if (a) { for (var q = 0; q < a; q += k) this.qB1x(e, q); q = e.splice(0, a); c.sigBytes -= j } return new r.init(q,j) }, clone: function() { var a = t.clone.call(this); a.i5n = this.i5n.clone(); return a }, GX6R: 0 }); l.Hasher = q.extend({ cfg: t.extend(), init: function(a) { this.cfg = this.cfg.extend(a); this.reset() }, reset: function() { q.reset.call(this); this.lJ9A() }, update: function(a) { this.vE3x(a); this.lg9X(); return this }, finalize: function(a) { a && this.vE3x(a); return this.mG0x() }, blockSize: 16, lV0x: function(a) { return function(b, e) { return (new a.init(e)).finalize(b) } }, vC3x: function(a) { return function(b, e) { return (new n.HMAC.init(a,e)).finalize(b) } } }); var n = d.algo = {}; return d}(Math);function example(){ i = a(16); h = {} h.encText = b({"rID":"R_SO_4_1817702136","threadID":"R_SO_4_1817702136","pageNo":"2","pageSize":"20","cursor":"1613900247044","offset":"40","orderType":"1","csrf_token":"d4339865ec133c9a7d77a25389bc0265"}, "0CoJUm6Qyw8W8jud") return h; }123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232嗐，又报错了，还是代码功能不全，这次又是缺少相应的函数：
Cannot read property ‘encrypt’ of undefined
莫得办法继续找代码，cv代码呗，逆向就是这样子要有耐心…
老样子，搜索encrypt这个参数，不过这个参数很奇怪，没有找到相应的生产函数，但是好像要联合几个函数一起执行，小夜斗就都给弄下来了！
嗐篇幅太长了，这里就不上Js代码了，后面文末自行获取即可！
上主要功能的Js代码吧，不然不好解释:
function example(){ i = a(16); h = {} h.encText = b({"rID":"R_SO_4_1817702136","threadID":"R_SO_4_1817702136","pageNo":"2","pageSize":"20","cursor":"1613900247044","offset":"40","orderType":"1","csrf_token":"d4339865ec133c9a7d77a25389bc0265"}, "0CoJUm6Qyw8W8jud") return h; }/*最后返回的h为: {'encText': 'ef07aa03b0c145b18ff7093a3ebe8428'}*/12345678910此时d函数内部
function d(d, e, f, g) { var h = {} , i = a(16); return h.encText = b(d, g), // 执行到此已经获取到变量i的值 h.encText = b(h.encText, i), // 开始执行这个步骤 h.encSecKey = c(i, e, f), h }12345678Js代码主函数功能:
function example(){ i = a(16); h = {} h.encText = b({"rID":"R_SO_4_1817702136","threadID":"R_SO_4_1817702136","pageNo":"2","pageSize":"20","cursor":"1613900247044","offset":"40","orderType":"1","csrf_token":"d4339865ec133c9a7d77a25389bc0265"}, "0CoJUm6Qyw8W8jud") h.encText = b(h.encText, i) return h;}/*最后返回的h为: {'encText': '09e1281f3bc506817b18eb63b2249c35dd295be25fe3de348d06930e670f81a9aa312bb4033e4f372964914b95d5f686'}每一次执行都是不一样的，动态变化!*/123456789101112此时d函数内部
function d(d, e, f, g) { var h = {} , i = a(16); return h.encText = b(d, g), // 执行到此已经获取到变量i的值 h.encText = b(h.encText, i), // 开始执行这个步骤 h.encSecKey = c(i, e, f), // 开始执行这个步骤, 调用c函数 h }12345678Js代码主函数功能:
function example(){ i = a(16); h = {} h.encText = b({"rID":"R_SO_4_1817702136","threadID":"R_SO_4_1817702136","pageNo":"2","pageSize":"20","cursor":"1613900247044","offset":"40","orderType":"1","csrf_token":"d4339865ec133c9a7d77a25389bc0265"}, "0CoJUm6Qyw8W8jud") h.encText = b(h.encText, i) h.encSecKey = c(i, "010001" , "00e0b509f6259df8642dbc35662901477df22677ec152b5ff68ace615bb7b725152b3ab17a876aea8a5aa76d2e417629ec4ee341f56135fccf695280104e0312ecbda92557c93870114af6c9d05c4f7f0c3685b7a46bee255932575cce10b424d813cfe4875d3e82047b97ddef52741d546b8e289dc6935b3ece0462db0a22b8e7") return h; }123456789执行后，报错了，因为缺少了没有定义的函数，然后后面一系列连续的这样子的报错，小夜斗自己弄了一个多小时才把函数补充完全，然后直接截图给大家伙看吧！
嗐，其实最后总结发现就是从那个！上面那里一直复制到第一次报错所需要的函数那里！
其实最后总结发现:
function d(d, e, f, g) { var h = {} , i = a(16); return h.encText = b(d, g), // 执行到此已经获取到变量i的值 h.encText = b(h.encText, i), // 开始执行这个步骤 h.encSecKey = c(i, e, f), // 开始执行这个步骤 h }asrsea = d;var bWv4z = asrsea(JsON.stringify(d), e, f, g);12345678910核心思想: 最终就是调用d这个函数，传入四个参数，最后得到的值是一个字典赋值给bWv4z, 然后b函数内部就牵扯到其它需要的函数，缺啥补啥就行！
var data = { params: bWv4z.encText, encSecKey: bWv4z.encSecKey } 12345然后这个字典中的encText和encSecKey对应的值就是params和encSecKey俩加密参数
{'params': 'GeZ2hGQu0LGQlB4VQebjp6n74Oq4/32rvafzEjRm9YSwMU7MBR9hC8f4riioTrVZIEn4zLXoPv+AVMUy5YV0Z/57uz6MbnX6pcyS99OSzJcvbBzgM5oTFpS2faYdUCIEyRYIWmna8c9SwS/yE+/EsaA3GMRpXoMhnV1ibdUY0/NUuDT5QpXjlNirryMJN0N66FvDT3yPS1aVEuCIEE9h3833g107ljF8vEkguSOBxi7eRMgT2W1nz9HQNJU5pniYsc8ntMeQESk4NblkNnEx6307E3uxMeAST2uJPchaTc4tb+TcDlZN/PLpz2OV62hJic9dNEfaxic7Jybvtn+I6lyyrD11x4xe4b7s915g5eo=', 'encSecKey': '8e8659fcff20f47c9823685b6b86cf976f7d7bfa9db447e3a8437839c0ed7837d529c9c7c245c9807f3277c85c6141f2621ad916c81d5db964eb56282d016142e4058db17aafb7bca8869b3fa537ba7422b347731526cc86e3c117277e3a569348ed51da09e5331ce3fad1c381c17fc0bef001a43cae46a22a48329c554c0f56'}1将这个俩参数拿到然后构建表单发送post请求
就拿到了如图所示的评论信息！
python代码如下:
#Coding:utf8# Todo: 正确的Js代码里面(网页上copy的有换行符)# 解决办法，先将代码copy到HBUILD里面, 然后执行Js代码import execJsimport requestsimport Jsonimport os,sys,io# Todo: UnicodeEncodeError: 'gbk' codec can't encode character '\U0001f44c' in position 3151: illegal multibyte sequence 报错sys.stdout = io.TextIOWrapper(sys.stdout.buffer,enCoding='gb18030')Js = open('./网易云.Js', 'r', enCoding='utf8').read()aim = execJs.compile(Js) # 生产Js对象data = aim.call('start') # 调用相应方法print(data) # 输出结果# comment接口url = "https://music.163.com/weAPI/comment/resource/comments/get?csrf_token=d4339865ec133c9a7d77a25389bc0265"# 请求头headers = { 'user-agent': 'Mozilla/5.0 (windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36 Edg/88.0.705.74', 'cookie': 'WM_TID=6S%2BVxiZNM4xBURVBQUYqChbHQqRPtWJo; _iuqxldmzr_=32; ntes_kaola_ad=1; _ntes_nnID=4a37e82e4fab3d88933e0d5c379d440e,1593854146443; _ntes_nuID=4a37e82e4fab3d88933e0d5c379d440e; vinfo_n_f_l_n3=65b5de1ae241f0fb.1.2.1596075019898.1596077656335.1596082873052; UM_distinctID=1776c974d24410-0bb2c863a112f2-50391c40-1fa400-1776c974d25bd1; NMTID=00olBs1TG5OHV33AkargjKWlPenameAAAF3i9nSKg; __csrf=d4339865ec133c9a7d77a25389bc0265; MUSIC_U=bed21edcbf5c4808fefc260d37faef01b6d633afc3be6807d7f44dcfc98c3d5433a649814e309366; WM_NI=FH%2Bdu5qU8nodD0Tz91k%2F%2BSZTQaN1uVEUrJ6lgO3CNyrzxn2qHc4gqOO5ytsdhxlqnw%2Fr02fjvENimgXplNN0Y%2BehIKexHjWU%2FJN05AfaCWE%2F9GO4sfosi0qw38qX3M8KaWs%3D; WM_NIKE=9ca17ae2e6ffcda170e2e6ee92fc6292f5ff89ca448cb08fa3d54a839e8e84f56ff58b8491b673b2b98ab3b42af0fea7c3b92a8698e585f83fb38bf88fee7088f09c9bbc3ba9f1e5b4d96093bf82d2f85e878bbeabb568a591fda4cd73b2a6b88fb17b8cbdfc88f4458debb795f270aca8a492ed7dedae00d3e562b69b828ad04d9cb0a4afcd3c9bf5ab89cc41a7a8888bd65fed9682d1b84ba6bf8db8c825fb9981d5f26eadada7d1f47df1e8bfb9b247fc95afb8f237e2a3; JsESSIONID-WYYY=1bOvTxGdlne5T%2B%5CvUNf761crAP4mCs4kXFSp25NsXXnrNWkrO5Tk8p5ykpnsb9X%2B%2F1ofrjxduvuZfC2kPNgz40bpqqlCgYlf1f2cXl%5C1yRO8aZ0IlubEo7n7xs0AX%2FffBDdG5t12CuiOPHI%5CZPleGyhEmbbOJt%2Bkt6XxSohZCQiQmPWr%3A1613963805180; WEVNSM=1.0.0; WNMCID=iuuttf.1613962005402.01.0', 'referer': 'https://music.163.com/song?ID=1817702136',}# POST请求r = requests.post(url=url, headers=headers, data=data)# 状态码200: 访问成功if r.status_code == 200: print("成功访问网易云接口") text = r.text.encode('utf8', "ignore").decode('utf8', "ignore") # Json格式转换 content = Json.loads(text) # print(content) # 获取评论信息: csv 与 txt 各一份 user_List = content['data']['comments'] # print(user_List) for user in user_List: # 主评论 if user['beReplIEd'] != None: for item in user['beReplIEd']: print(item['content']) # 回复评论 # print(user['content'])else: print("error")1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950ps ： 逆向过程的基本上是去扣源码或者自己用python或其他语言复刻出源码中所需要的功能来得到你加密的参数，少什么函数就扣下来放到Js文件中，就这样一部部来，总之很麻烦！
上述只是爬取一页的代码，如果需要拿去多页的话，就用重写函数定义传参即可，d中滴参数上述已经描述了！
然后小夜斗这边试了一下，希望有大佬看到能够指点一下，为什么到了第十页就爬取不了了！欢迎各位大佬评论区留言
小夜斗的python代码如下:
#Coding:utf8# Todo: 正确的Js代码里面(网页上copy的有换行符)# 解决办法，先将代码copy到HBUILD里面, 然后执行Js代码import execJsimport requestsimport Jsonimport os,sys,ioimport time# Todo: UnicodeEncodeError: 'gbk' codec can't encode character '\U0001f44c' in position 3151: illegal multibyte sequence 报错sys.stdout = io.TextIOWrapper(sys.stdout.buffer, enCoding='gb18030')page = int(input("输入要查询的页码数:"))for i in range(1, page+1): print(f'i:{i}') # 偏移量 offset = str(i * 20) # offset = str(0) # 13为时间戳 cursor = str(int(time.time() * 1000)) Js = open('./网易云.Js', 'r', enCoding='utf8').read() aim = execJs.compile(Js) # 生产Js对象 data = aim.call('start', offset, str(page), cursor) # 调用相应方法 # print(data) # 输出结果 # comment接口 url = "https://music.163.com/weAPI/comment/resource/comments/get?csrf_token=d4339865ec133c9a7d77a25389bc0265" # 请求头 headers = { 'user-agent': 'Mozilla/5.0 (windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/88.0.4324.182 Safari/537.36 Edg/88.0.705.74', 'cookie': 'WM_TID=6S%2BVxiZNM4xBURVBQUYqChbHQqRPtWJo; _iuqxldmzr_=32; ntes_kaola_ad=1; _ntes_nnID=4a37e82e4fab3d88933e0d5c379d440e,1593854146443; _ntes_nuID=4a37e82e4fab3d88933e0d5c379d440e; vinfo_n_f_l_n3=65b5de1ae241f0fb.1.2.1596075019898.1596077656335.1596082873052; UM_distinctID=1776c974d24410-0bb2c863a112f2-50391c40-1fa400-1776c974d25bd1; NMTID=00olBs1TG5OHV33AkargjKWlPenameAAAF3i9nSKg; __csrf=d4339865ec133c9a7d77a25389bc0265; MUSIC_U=bed21edcbf5c4808fefc260d37faef01b6d633afc3be6807d7f44dcfc98c3d5433a649814e309366; WM_NI=d1%2F2Zolk6b6YJnwdLJEo2E4vkr7u2MMvjXLw34zWu7E15cNm%2BUQL7G14j36Nw4Y1JMsQZzutuQr%2FBeI1EiTJIp7tOnFsp%2F63a6a8MFDWIwVCaeh7P9%2FjfqQJTf28V7XVY3I%3D; WM_NIKE=9ca17ae2e6ffcda170e2e6eeb5b769b097faa2f64eae868eb2c54b979e9e85b645f58c8ab5c67a8fb197b5aa2af0fea7c3b92aa8efe1d3d96590b5fa83b5538ab2b985cf4287b1fea6b77ea9aef996b1478faaa6b9cf7df1ecb6b8f83d87effb84cd67e98b9fadb64df3eca6d4b546b5ec97d2c947b18f969bf880b78fbed0c16f8bef8b8ad7428bb0f995ce6686adc0d0b539a3eaafd9d04e88898798d549a3bba8d8d333edb6aa92d44298bafed9d53d9c8a97d4cc37e2a3; __root_domain_v=.163.com; _qddaz=QD.uerirb.s0cddl.klgiphn9; hb_MA-9F44-2FC2BD04228F_source=www.baIDu.com; JsESSIONID-WYYY=Dnl9Q%5CsA%5CgFxr35Z6Yop8S4cgUw2XbSi63P5%5CylO1H9i%5CiJfKGDN7wYoc6nyGftQ6UtwmY5A6PTypX2mR147jRrZkF2zDqwuyQA4%2F%2F3CQnOhFKXz57z8WCCHeX9%5Cz%2BtVzo%2Byu%2B5un%5CR4af37PI%2Bxj7FNIbe9dCG9pRuMZ%2Bv4mGhyJG90%3A1613996422319; WEVNSM=1.0.0; WNMCID=sqowiw.1613994622490.01.0', 'referer': 'https://music.163.com/song?ID=1817702136', } # POST请求 r = requests.post(url=url, headers=headers, data=data) # 状态码200: 访问成功 if r.status_code == 200: # print("成功访问网易云接口") text = r.text.encode('utf8', "ignore").decode('utf8', "ignore") # Json格式转换 content = Json.loads(text) # print(content) # 获取评论信息: csv 与 txt 各一份 user_List = content['data']['comments'] # print(user_List) for user in user_List: # 主评论 if user['beReplIEd'] != None: for item in user['beReplIEd']: print(item['content']) with open('星辰大海.txt', 'a', enCoding="utf8") as f: f.write(item['content']) f.write('\n') f.write(user['content']) f.write('\n') # 回复评论 print(user['content']) time.sleep(0.5) else: print("error")123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869二：利用sNownpl进行情感分析首先没有安装这个库的小伙伴安装可以先安装！
pip install sNownlp1
这个库怎么说呢，小夜斗感觉就是专门针对中文进行情感判断的，因为这篇重心是在于Js逆向，情感分析就简单点啦！
首先我们来看这个库的基本使用:
from sNownlp import SNowNLP# 进行分词sentence = u'欢迎大家订阅小夜斗的博客'# 调用函数生产分词对象word_List = SNowNLP(sentence)print(word_List) # <sNownlp.SNowNLP object at 0x000001C49B6E8D68>print(word_List.words) # ['欢迎', '大家', '订阅', '小夜', '斗', '的', '博', '客']# 用空格进行分隔print(' '.join(word_List.words)) # 欢迎 大家 订阅 小夜 斗 的 博 客# 判断这句话情感分数emotion_score = word_List.sentiments print(emotion_score) # 0.22639671918900761234567891011121314看样子这句话情感分数不是很高哈，不知道是不是没有调参的原因，问题不大，今天小夜斗就简单介绍这个库的使用哈！
下面我们再来看一句话
# 表白神句sentence_2 = "我喜欢你，我想和你在一起！"word_List_2 = SNowNLP(sentence_2)emotion_score_2 = word_List_2.sentimentsprint(emotion_score_2) # 0.714404711219326712345
嗯看起来还行，0.7的评分，最高也就是1了！
# 难受神句sentence_3 = "我讨厌你，我不想和你在一起！"word_List_3 = SNowNLP(sentence_3)emotion_score_3 = word_List_3.sentimentsprint(emotion_score_3) # 0.373691201007501412345
小夜斗此时哭晕在厕所，我的天这句讨厌人的话评分竟然比小夜斗欢迎人的话还高，嗯！肯定是因为没有经过模型训练的原因，对！
问题不大问题不大，接下来生成一个简单词云看看！
# -*- Coding: utf-8 -*-import jIEbaimport sysimport matplotlib.pyplot as pltfrom wordcloud import WordCloud# 打开本体TXT文件text = open('星辰大海.txt', enCoding='utf8').read()print(type(text))# 结巴分词 cut_all=True 设置为精准模式wordList = jIEba.cut(text, cut_all=False)# 使用空格连接 进行中文分词wl_space_split = " ".join(wordList)print(wl_space_split)# 对分词后的文本生成词云wc = WordCloud( background_color="white", # 背景颜色 max_words=200, # 显示最大次数 Font_path=r'C:/windows/Fonts/STXINGKA.TTF', # 字体 wIDth=400, # 宽 height=200, # 高 scale=10).generate(wl_space_split)# 显示词云图plt.imshow(wc)# 是否显示x轴、y轴下标plt.axis("off")plt.show()1234567891011121314151617181920212223242526272829303132星辰大海这首歌呢，双向奔赴，是一首爱情歌曲吧，9页评论出现最多的是喜欢、惊喜、花，这就是爱情嘛！
打开星辰大海.txt这个评论文本文件，对每其中每一句评论进行情感分析，进而画出一个柱状图，看整个歌曲的情感倾斜如何！
# -*- Coding: utf-8 -*-# 1.情感各分数段出现频率from sNownlp import SNowNLPimport codecsimport ossource = open("星辰大海.txt", "r", enCoding="utf8")line = source.readlines()sentimentsList = []for i in line: s = SNowNLP(i.encode("utf-8").decode("utf-8")) print(s.sentiments) sentimentsList.append(s.sentiments)import matplotlib.pyplot as pltimport numpy as np# 加载字体plt.rcParams['Font.sans-serif'] = ['SimHei'] # 指定默认字体# 显示负号plt.rcParams['axes.unicode_minus'] = Falseplt.hist(sentimentsList, bins=np.arange(0, 1, 0.01), facecolor='g')plt.xlabel('情感评分', size=12)plt.ylabel('某个情感评分的数量', size=12)plt.Title('星辰大海整体情感分析', color="red", size=12)plt.show()1234567891011121314151617181920212223242526星辰大海这首歌呢强调的是爱情是双向奔赴，从个人主观判断上来看整首歌更倾向于正面积极、但也不缺乏某些因为爱情感到难过悲伤的人，从上述柱状图来看大致分布是在[0.5, 1]区间之间，其中[0.8,1]区间的人数占比较大，消极评论[0,0.2]只有那么一两个，可能是因为被爱情伤透了心吧！
近期有很多朋友通过私信咨询有关Python学习问题。为便于交流，点击蓝色自己加入讨论解答资源基地
总结
以上是内存溢出为你收集整理的python逆向爬取网易云评论进行情感分析！网易评论才是高手全部内容，希望文章能够帮你解决python逆向爬取网易云评论进行情感分析！网易评论才是高手所遇到的程序开发问题。
如果觉得内存溢出网站内容还不错，欢迎将内存溢出网站推荐给程序员好友。
欢迎分享，转载请注明来源：内存溢出
微信扫一扫
支付宝扫一扫
评论列表（0条）