Presentation: "Amazon and Hadoop"
Time:
Wednesday 17:15 - 18:15
Location:
Metropolitan I
Abstract: Hadoop, one incarnation of MapReduce algorithm, is a framework that allows computation of large datasets by splitting the dataset into manageable chunks, spreading it across a fleet of machines and managing the overall process by launching jobs, processing the job no matter where the data is physically located and, at the end, aggregating the job output into a final result.
Amazon Web Services? Alexa Web Search Service uses Hadoop in production. Developers are now able to run a small regular expression over millions of documents crawled by Alexa and filter the search results, in a cost-effective manner.
In this talk, Jinesh Varia, Evangelist for Amazon Web Services, will share some of the architectural insights of this usecase, problems we faced and problem it solved.
As a Web Services Evangelist at Amazon, Jinesh Varia helps developers take advantage of disruptive technologies that are going to change the way we think about computer applications, and the way businesses compete. Jinesh is focused on furthering awareness of web services and often helps developers on 1:1 basis, helping them implement their own ideas using Amazon's innovative services.
Jinesh has over 7 years experience in XML and Web services and has worked with standard working groups in XBRL. Prior to joining Amazon as an evangelist, he held several positions in UBmatrix including Solutions Architect, Enterprise Team Lead and Software engineer, working on various financial services projects including Call Modernization Project at FDIC. He was also lead developer at Penn State Data Center, Institute of Regional Affairs. Jinesh's publications have been published in ACM and IEEE. Jinesh is originally from India and holds a Master's degree in Information Systems from Penn State University. He plays tennis and loves to trek.
