# Python_Spider

**Repository Path**: QinMuYiTong/python_-spider

## Basic Information

- **Project Name**: Python_Spider
- **Description**: 个人网络爬虫学习
- **Primary Language**: Python
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2024-04-17
- **Last Updated**: 2025-03-23

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

[toc]

# 笔记
https://juejin.cn/column/7423213167717253147

# 1. 爬虫Requests库

参考链接:

https://liaoxuefeng.com/books/python/third-party-modules/requests/index.html

https://www.runoob.com/python3/python-requests.html

https://www.w3cschool.cn/requests2/

# 2.Curl Command 转Python requests

https://www.lddgo.net/convert/curl-to-code



# 3.Xpath

https://www.w3school.com.cn/xpath/index.asp

https://learn.microsoft.com/zh-cn/previous-versions/dotnet/netframework-2.0/ms256039(v=vs.80)?redirectedfrom=MSDN



# Beautiful Soup

https://beautifulsoup.readthedocs.io/zh-cn/v4.4.0/#id7



# whl下载网址

https://pypi.tuna.tsinghua.edu.cn/simple/

```

pip install whl离线文件(拖进来即可)
```

# selenium

https://www.selenium.dev/zh-cn/documentation/webdriver/getting_started/

https://www.runoob.com/python3/python-selenium.html



# 验证码图像识别技术

ddddocr : https://pypi.org/project/ddddocr/

https://github.com/sml2h3/ddddocr

Tesseract: https://github.com/tesseract-ocr/tesseract

# Scrapy框架
https://github.com/scrapy/scrapy

https://scrapy.org/

https://scrapy.net.cn/download/

https://docs.scrapy.org/en/latest/