Search Tech Blog

Writing Your Own Search Engine is Hard

W

Why is it so hard?

Anna Patterson, Software Engineer. As well as contributed to search engines and artificial intelligence at Google, and co-founded Cuil. Makes following quotation about developing search engines:

“There must be 4,000 programmers typing away in their basements trying to build the next “world’s most scalable” search engine. It has been done only a few times. It has never been done by a big group; always one to four people did the core work, and the big team came on to build the elaborations and the production infrastructure. Why is it so hard?”

Let me introduce Anna Patterson

What Wikipedia knows about her:

Patterson received her B.S. in Computer Science and another in Electrical Engineering from Washington University. As well her Ph.D. from the University of Illinois at Urbana–Champaign and was a Research Scientist at Stanford University in artificial intelligence working on Phenomenal Data Mining.

She was working in Google’s Android organization. Patterson was responsible for scaling up Android from 40 million phones to over 800 million phones.

She was a co-founder of Cuil, a clustering-based search engine (which she created after leaving Google in 2007). And also wrote Recall.archive.org (part of the Wayback Machine), a history-based search engine out of the Internet Archive, which showed trends over time.

Patterson was a winner of the 2016 ABIE Award, and one of the seminal contributors to search engines. As of 2017 she was Founder and Managing Partner at Gradient Ventures and Vice President of Engineering at Google.

Read the hole Story

Why Writing Your Own Search Engine is Hard
Why Writing Your Own Search Engine is Hard

In addition to this, please read the complete article that Anna Patterson had already written in 2004 about “Why Writing Your Own Search Engine is Hard” and still so true: https://queue.acm.org/detail.cfm?id=988407

About the author

I. Gaffling

I would like to introduce myself, my name is Igor Gaffling, I was born in 1968 and have more than 30 years of experience in the IT- and new-media industry. In this blog I write about how search engines work, facts, ideas, code experiments and the possibility to develop a simple search engine from scratch that can handle a few million entries at an acceptable speed.

1 comment

By I. Gaffling
Search Tech Blog

Latest posts

Latest comments

Categories

Tag Cloud