Processing and anonymizing billions of position data points
AI algorithms, cloud platforms, and big data solutions now enable the quick, anonymous, efficient, and cost-effective analysis of customer data. Using a cloud solution and an anonymization technique, a robust end-to-end and state-of-the-art pipeline has been built to process and anonymize billions of position data points in a cost- and performance-optimized fashion. This requires a cloud solution with massive scalability and the ability to visualize big data.
This anonymized GPS position data can be used to analyze customer behavior – securely and in compliance with data protection regulations.
Our Analytics & AI team has built a robust end-to-end pipeline in the cloud and developed a new anonymization method, which has now been patented. The required IT architecture is highly scalable to ensure that it can reliably handle even very large workloads. We can now visualize Big Data thanks to the intelligent merging of data and our expertise in the field of technology and innovation.
Three questions for
Yildirim, Mercedes-Benz
Consulting,
Data & Tech
What was challenging for you during the project?
The challenge was to develop an end-to-end pipeline from the ground up and meet the criteria of stability, reliability, scalability, anonymization, cost-optimization, performance-optimization, and state-of-the-art technology. When billions of data points have to be processed, every single step has to be clearly thought out, and every avoidable calculation must be prevented in order to meet the above criteria.
What is the take-away for you personally?
Teamwork is paramount for very complex and comprehensive projects such as this, because different skill sets are required for different challenges and solutions.
What does the future have in store?
From what we have learned from actual customer behavior, there are innumerable possible applications in the field of data analytics. The next steps that we should take are strategically important use cases that can only be analyzed with our processed and anonymized data. This is how we actively shape the future and help our customers move forward.