DATALAKE WITH DATA SOURCES

Challenges

The purpose was to build an AWS Data lake with data sources using Salesforce, Oracle RDBMS, Twitter, LinkedIn and Clickstream.

Solutions

• Developed Various ingestion application to pull data from the listed sources leveraging Salesforce/Twitter/LinkedIn API's to capture user community information.
• Event driven using AWS Lambda/EC2/Glue to process data, partition it and compares it before storing it to Refined Zone in AWS S3.
• The client can effectively query data as per the business use cases and view their data in Business Intelligence tool which is SAP Lumira.

ROI

• User Community data is to inform design and development based on behavioural data which will provide insights to improve the product and service line.
• Ability to track down user community traffic to perform Web Based Analytics.
• Creating Personalized experience and reaching relevant audience.