Data Platform

Building a Secure, Scalable Customer Data Platform for a Large Advertising Holding Company

Client Overview

Our friends at a large advertising holding company engaged The Data Sherpas (TDS) to collaborate with their teams to identify current, near-term, and long-term goals. We launched the client’s AWS account from scratch and built a secure, scalable customer data platform to handle PII data in less than three months.

Project Scope

The project involved creating a robust data platform to onboard data from over 100 external sources daily, ensuring high availability and security. The scope included:

Business and Technology Strategy:

Provided comprehensive strategies for both business and technology aspects.

Program Management:

Managed the entire program from inception to deployment.

Application and Platform Development:

Developed secure and scalable applications and platforms.

API Development:

Built APIs for seamless data integration.

Quality Assurance:

Ensured high standards of quality throughout the project.

Reporting and Analytics:

Enabled data-driven insights through advanced reporting and analytics.

Solutions Delivered

Hi-Trust Certified Platform:

Built a secure platform certified for handling sensitive PII data.

Microservice Architecture:

Implemented a microservice architecture for cloud data services accessible to internal and external users.

Cloud Data Services:

Transitioned the client from no cloud presence to a massive cloud infrastructure, currently managing 8 exabytes of data.

Data Platform Development:

Created a platform for first, second, and third-party data to drive insights and advertising effectiveness.

Snowflake Data Platform:

Implemented and optimized the Snowflake data platform.

Clean Room Design:

Designed and built the first ‘clean room’ with Snowflake, HMI, and clients for secure data analysis.

Data Exchange Platform:

Built a platform allowing the client to service 80+ clients with data-driven insights in advertising.

AI/ML Integration:

Leveraged Azure and AWS AI/ML services, including OpenAI GPT 3, 3.5, and 4, and Anthropic for advanced natural language querying and audience segmentation.

Results

The platform contributed to a twenty percent revenue increase in its first year. Over a five-year relationship, TDS provided continuous support in technology strategy, data strategy, platform development, operations, and support. The platform’s robust design and implementation ensured it could meet evolving business needs and efficiently handle vast amounts of data.