{"id":861,"date":"2021-01-27T23:05:52","date_gmt":"2021-01-27T15:05:52","guid":{"rendered":"https:\/\/byy3.com\/?p=861"},"modified":"2021-01-27T23:05:52","modified_gmt":"2021-01-27T15:05:52","slug":"python3%e4%bd%bf%e7%94%a8newspaper%e5%ba%93%e6%8f%90%e5%8f%96%e6%96%b0%e9%97%bb%e5%86%85%e5%ae%b9readability%ef%bc%8cjparser","status":"publish","type":"post","link":"https:\/\/byy3.com\/?p=861","title":{"rendered":"python3\u4f7f\u7528newspaper\u5e93\u63d0\u53d6\u65b0\u95fb\u5185\u5bb9(readability\uff0cjparser)"},"content":{"rendered":"

\u4e4b\u524d\u4f7f\u7528\u5176\u4ed6\u65b9\u6cd5\uff0c\u8bf8\u5982xpath\uff0ccss\uff0c\u6b63\u5219\u8868\u8fbe\u5f0f\uff0cbeautifulsoup\u6765\u89e3\u6790\u65b0\u95fb\u9875\u9762\u7684\u65f6\u5019\uff0c\u603b\u662f\u4f1a\u9047\u5230\u8fd9\u6837\u90a3\u6837\u5404\u79cd\u5947\u5947\u602a\u602a\u7684\u95ee\u9898\uff0c\u8ba9\u4eba\u5f88\u5934\u75bc\u3002<\/p>\n

\u6700\u8fd1\u5b66\u5230\u4e00\u4e2a\u65b0\u7684\u5305newspaper\uff0c\u7528\u6765\u6293\u53d6\u65b0\u95fb\u6b63\u6587\uff0c\u771f\u7684\u5f88\u597d\u7528\u5462\u3002<\/p>\n

\u8fd9\u4e2a\u5305\u662f\u9700\u8981\u81ea\u5df1\u91cd\u65b0\u5b89\u88c5\u7684\uff0c\u6211\u4f7f\u7528\u7684\u662fpycharm\u3002<\/p>\n

\"python3\u4f7f\u7528newspaper\u5e93\u63d0\u53d6\u65b0\u95fb\u5185\u5bb9(readability\uff0cjparser)\u63d2\u56fe\"\u5728settings\u914d\u7f6e\u73af\u5883\uff0c\u6dfb\u52a0\u5305newspaper\u7684\u65f6\u5019\u603b\u662f\u6dfb\u52a0\u4e0d\u8fdb\u53bb\u3002\u90a3\u5c31pip\u5427\uff01<\/p>\n

\u4e8e\u662f\u6253\u5f00\u547d\u4ee4\u884c\u7a97\u53e3\uff0c\u8f93\u5165pip3 install --ignore-installed --upgrade newspaper3k\uff0c\u7b49\u5f85\u4e00\u4f1a\u5c31\u5b89\u88c5\u597d\u4e86\u3002<\/p>\n

\u5982\u679c\u6587\u7ae0\u6ca1\u6709\u6307\u660e\u4f7f\u7528\u7684\u4ec0\u4e48\u8bed\u8a00\u7684\u65f6\u5019\uff0cNewspaper\u4f1a\u5c1d\u8bd5\u81ea\u52a8\u8bc6\u522b\u3002<\/p>\n

<\/code><\/pre>\n
    \n
  1. \n
    \n
    <\/div>\n<\/div>\n
    \n
    from<\/span> newspaper import<\/span> Article<\/div>\n<\/div>\n<\/li>\n
  2. \n
    \n
    <\/div>\n<\/div>\n
    \n
    url = '\u4f60\u60f3\u8981\u722c\u53d6\u7684\u7f51\u7ad9url'<\/span><\/div>\n<\/div>\n<\/li>\n
  3. \n
    \n
    <\/div>\n<\/div>\n
    \n
    news = Article(url, language='zh'<\/span>)<\/div>\n<\/div>\n<\/li>\n
  4. \n
    \n
    <\/div>\n<\/div>\n
    \n
    news .download()<\/div>\n<\/div>\n<\/li>\n
  5. \n
    \n
    <\/div>\n<\/div>\n
    \n
    news .parse()<\/div>\n<\/div>\n<\/li>\n
  6. \n
    \n
    <\/div>\n<\/div>\n
    \n
    print<\/span>(news.text)<\/div>\n<\/div>\n<\/li>\n
  7. \n
    \n
    <\/div>\n<\/div>\n
    \n
    print<\/span>(news.title)<\/div>\n<\/div>\n<\/li>\n
  8. \n
    \n
    <\/div>\n<\/div>\n
    \n
    print<\/span>(news.html)<\/div>\n<\/div>\n<\/li>\n
  9. \n
    \n
    <\/div>\n<\/div>\n
    \n
    print<\/span>(news.authors)<\/div>\n<\/div>\n<\/li>\n
  10. \n
    \n
    <\/div>\n<\/div>\n
    \n
    print<\/span>(news.top_image)<\/div>\n<\/div>\n<\/li>\n
  11. \n
    \n
    <\/div>\n<\/div>\n
    \n
    print<\/span>(news.movies)<\/div>\n<\/div>\n<\/li>\n
  12. \n
    \n
    <\/div>\n<\/div>\n
    \n
    print<\/span>(news.keywords)<\/div>\n<\/div>\n<\/li>\n
  13. \n
    \n
    <\/div>\n<\/div>\n
    \n
    print<\/span>(news.summary)<\/div>\n<\/div>\n<\/li>\n<\/ol>\n
    <\/code><\/pre>\n
    <\/div>\n
    \u4e5f\u53ef\u4ee5\u76f4\u63a5\u5bfc\u5165\u5305,\u5982\u679c\u8bed\u8a00\u662f\u4e00\u81f4\u7684\uff0c\u4e5f\u53ef\u4ee5\u76f4\u63a5\u58f0\u660e<\/p>\n
    <\/code><\/pre>\n
      \n
    1. \n
      \n
      <\/div>\n<\/div>\n
      \n
      import<\/span> newspaper<\/div>\n<\/div>\n<\/li>\n
    2. \n
      \n
      <\/div>\n<\/div>\n
      \n
      news = newspaper.build(url, language='zh'<\/span>)<\/div>\n<\/div>\n<\/li>\n
    3. \n
      \n
      <\/div>\n<\/div>\n
      \n
      article = news.articles[0<\/span>]<\/div>\n<\/div>\n<\/li>\n
    4. \n
      \n
      <\/div>\n<\/div>\n
      \n
      article.download()<\/div>\n<\/div>\n<\/li>\n
    5. \n
      \n
      <\/div>\n<\/div>\n
      \n
      article.parse()<\/div>\n<\/div>\n<\/li>\n
    6. \n
      \n
      <\/div>\n<\/div>\n
      \n
      print<\/span>(article.text)<\/div>\n<\/div>\n<\/li>\n<\/ol>\n
      <\/code><\/pre>\n