DATALAKE WITH DATA SOURCES
Challenges
The purpose was to build an AWS Data lake with data sources using Salesforce, Oracle RDBMS, Twitter, LinkedIn and Clickstream.
Solutions
- Developed Various ingestion application to pull data from the listed sources leveraging Salesforce/Twitter/LinkedIn API's to capture user community information.
- Event driven using AWS Lambda/EC2/Glue to process data, partition it and compares it before storing it to Refined Zone in AWS S3.
- The client can effectively query data as per the business use cases and view their data in Business Intelligence tool which is SAP Lumira.
ROI
- User Community data is to inform design and development based on behavioural data which will provide insights to improve the product and service line.
- Ability to track down user community traffic to perform Web Based Analytics.
- Creating Personalized experience and reaching relevant audience.