This is an essential update for everyone to fully enjoy Scrapling as it's intended.
What's changed
New full documentation website
- Yup, finally 😄 Check it out from here
Unified import logic for fetchers
- Now you can import all fetchers with
from scrapling.fetchers import Fetcher, AsyncFetcher, StealthyFetcher, PlayWrightFetcher
, then use them directly likepage = Fetcher.get(...)
without initialization.
This replaces this old importfrom scrapling.defaults import Fetcher, AsyncFetcher, StealthyFetcher, PlayWrightFetcher
.
Breaking change: automatch is now turned off by default
- Now there's new logic to enable automatch from fetchers or other parsing options. Check out the documentation page for details.
Old imports and logic are left usable with a warning for backward compatibility.
New options added to fetchers
- Now, both
StealthyFetcher
andPlayWrightFetcher
have a new argument while fetching calledwait
. This makes the fetcher wait/sleep for a specific period (milliseconds) before closing the page and returning the response to you. - Now
StealthyFetcher
methodsfetch
andasync_fetch
have the argumentadditional_arguments
to be passed to Camoufox as additional settings, which takes higher priority than Scrapling's settings (#54 )
Bugs squashed
- Fixed a bug in
async_fetch
in bothStealthyFetcher
andPlayWrightFetcher
classes, with catching redirections.
Thanks for all your support and donations!