Server status ...

loongson/pypi/: scrapy-2.6.1 metadata and description

Homepage Simple index

A high-level Web Crawling and Web Scraping framework

author Scrapy developers
classifiers
  • Framework :: Scrapy
  • Development Status :: 5 - Production/Stable
  • Environment :: Console
  • Intended Audience :: Developers
  • License :: OSI Approved :: BSD License
  • Operating System :: OS Independent
  • Programming Language :: Python
  • Programming Language :: Python :: 3
  • Programming Language :: Python :: 3.6
  • Programming Language :: Python :: 3.7
  • Programming Language :: Python :: 3.8
  • Programming Language :: Python :: 3.9
  • Programming Language :: Python :: 3.10
  • Programming Language :: Python :: Implementation :: CPython
  • Programming Language :: Python :: Implementation :: PyPy
  • Topic :: Internet :: WWW/HTTP
  • Topic :: Software Development :: Libraries :: Application Frameworks
  • Topic :: Software Development :: Libraries :: Python Modules
license BSD
maintainer Pablo Hoffman
maintainer_email pablo@pablohoffman.com
project_urls
  • Documentation, https://docs.scrapy.org/
  • Source, https://github.com/scrapy/scrapy
  • Tracker, https://github.com/scrapy/scrapy/issues
requires_dist
  • Twisted (>=17.9.0)
  • cryptography (>=2.0)
  • cssselect (>=0.9.1)
  • itemloaders (>=1.0.1)
  • parsel (>=1.5.0)
  • pyOpenSSL (>=16.2.0)
  • queuelib (>=1.4.2)
  • service-identity (>=16.0.0)
  • w3lib (>=1.17.0)
  • zope.interface (>=4.1.3)
  • protego (>=0.1.15)
  • itemadapter (>=0.1.0)
  • setuptools
  • tldextract
  • lxml (>=3.5.0) ; platform_python_implementation == "CPython"
  • PyDispatcher (>=2.0.5) ; platform_python_implementation == "CPython"
  • lxml (>=4.0.0) ; platform_python_implementation == "PyPy"
  • PyPyDispatcher (>=2.1.0) ; platform_python_implementation == "PyPy"
requires_python >=3.6
File Tox results History
Scrapy-2.6.1-py2.py3-none-any.whl
Size
258 KB
Type
Python Wheel
Python
2.7
Scrapy-2.6.1.tar.gz
Size
1 MB
Type
Source
https://scrapy.org/img/scrapylogo.png

Scrapy

PyPI Version Supported Python Versions Ubuntu macOS Windows Wheel Status Coverage report Conda Version

Overview

Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

Scrapy is maintained by Zyte (formerly Scrapinghub) and many other contributors.

Check the Scrapy homepage at https://scrapy.org for more information, including a list of features.

Requirements

  • Python 3.6+
  • Works on Linux, Windows, macOS, BSD

Install

The quick way:

pip install scrapy

See the install section in the documentation at https://docs.scrapy.org/en/latest/intro/install.html for more details.

Documentation

Documentation is available online at https://docs.scrapy.org/ and in the docs directory.

Releases

You can check https://docs.scrapy.org/en/latest/news.html for the release notes.

Community (blog, twitter, mail list, IRC)

See https://scrapy.org/community/ for details.

Contributing

See https://docs.scrapy.org/en/master/contributing.html for details.

Code of Conduct

Please note that this project is released with a Contributor Code of Conduct (see https://github.com/scrapy/scrapy/blob/master/CODE_OF_CONDUCT.md).

By participating in this project you agree to abide by its terms. Please report unacceptable behavior to opensource@zyte.com.

Companies using Scrapy

See https://scrapy.org/companies/ for a list.

Commercial Support

See https://scrapy.org/support/ for details.