Pregunta de entrevista de Databricks

How would you implement a web-crawler