Skip to content

Commit b4bb0cc

Browse files
authored
Update simple-crawling.md
Fixing wrong documentation about th fit_markdown to assume its a direct parameter of CrawlerRunConfig, while it is NOT.
1 parent 897e017 commit b4bb0cc

File tree

1 file changed

+8
-1
lines changed

1 file changed

+8
-1
lines changed

docs/md_v2/core/simple-crawling.md

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,9 +31,16 @@ if __name__ == "__main__":
3131
The `arun()` method returns a `CrawlResult` object with several useful properties. Here's a quick overview (see [CrawlResult](../api/crawl-result.md) for complete details):
3232

3333
```python
34+
config = CrawlerRunConfig(
35+
markdown_generator=DefaultMarkdownGenerator(
36+
content_filter=PruningContentFilter(threshold=0.6),
37+
options={"ignore_links": True}
38+
)
39+
)
40+
3441
result = await crawler.arun(
3542
url="https://example.com",
36-
config=CrawlerRunConfig(fit_markdown=True)
43+
config=config
3744
)
3845

3946
# Different content formats

0 commit comments

Comments
 (0)