cdransf/ai.robots.txt
1
1
Fork 0
mirror of https://github.com/ai-robots-txt/ai.robots.txt.git synced 2025-04-04 19:13:57 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 1

Merge pull request #46 from isagalaev/case-insensitive-sorting

Browse source 
Sort the content of robots.json by keys, case-insensitively
This commit is contained in:
Glyn Normington 2024-10-18 07:57:56 +01:00 committed by GitHub
commit 898c8ab82d
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 3 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
code/dark_visitors.py
View file

@ -70,4 +70,6 @@ for section in soup.find_all("div", {"class": "agent-links-section"}):
}
print(f"Total: {len(existing_content)}")
Path("./robots.json").write_text(json.dumps(existing_content, indent=4, sort_keys=True))
sorted_keys = sorted(existing_content, key=lambda k: k.lower())
existing_content = {k: existing_content[k] for k in sorted_keys}
Path("./robots.json").write_text(json.dumps(existing_content, indent=4))