To help manage its increasingly massive amounts of data, Twitter has hired Utkarsh Srivastava, who most recently served as a senior research scientist at Yahoo. Reported to be a highly respected
scientist, Srivastava is best known for his work on building large-scale distributed systems, specifically his efforts with Hadoop. Hadoop, similar to the Google File System, is a framework that
enables applications to work over distributed "server nodes" and significant data sets.
At Yahoo, Srivastava was one of the original designers of "Pig", an Apache project for analyzing
large data sets, which leveraged Hadoop. It's not yet clear whether Srivastava will focused on specific project areas, or broadly scaling the micro-blogging service for future growth.
Read the whole story at louisgray.com »
