Loading Events

« All sessions

Big Data

PayPal: Creating a Central Data Backbone: Couchbase to Couchbase to Kafka to Hadoop and Back

Running a site like PayPal requires both huge scale and a lot of processing to support a complex growing business. Over time, the PayPal business faces a challenge in managing the user information required to run PayPal services. By leveraging Couchbase, the PayPal Data Service team is able to accommodate fast access to user information at scale while streaming data into Hadoop. The solution is able to process millions of updates a minute while leveraging Kafka’s high throughput capabilities to get this user data into the Hadoop cluster.