Simon Willison’s Weblog

lxml: an underappreciated web scraping library. I just wish I could get the wretched thing to install on OS X Leopard without resorting to MacPorts.

Posted 11th December 2008 at 9:54 am

Recent articles

ChatGPT agent's user-agent - 4th August 2025
The ChatGPT sharing dialog demonstrates how difficult it is to design privacy preferences - 3rd August 2025
Reverse engineering some updates to Claude - 31st July 2025

ian-bicking 15 lxml 7 macports 2 python 1170 scraping 37

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe