Kynetec: 4x Faster Processing Times Thanks to Improved Automation
To optimize data processing times, Kynetec moved their solution to a serverless architecture and replaced relational databases with Cloud-based solutions with better horizontal scaling.
Scroll down for more
Business Benefits
The initial MVP used a cloud-managed SQL database service as the main data processing platform. This was transitioned to a file-based storage service, using serverless features where feasible to minimize the resource footprint when not in use. Raw data can now be cleaned significantly faster and more efficiently, enabling Analysts to spend more time creating value-added insights.
- With Managed Spark Computing clusters, average raw data processing times were reduced by 77%.
- Effective processes allowed Data Analysts to spend more time producing richer insights
Results by Numbers
77%
77% Increased Data Processing Efficiency
Business Need
Kynetec processes large amounts of raw data to create industry reports for their clients. Working on such sizable data volumes, to some extent manually, took up a lot of their Analysts’ time. After implementing an MVP – the first step to introducing automation – Kynetec decided to further expand their new solution to free up Data Analysts to work on more meaningful tasks.
PGS Software plays a pivotal role in us meeting our objectives against automating and enhancing our Data Pipelines. The value-driven approach ensures changes are prioritised and where the effort may be significant, PGS Software deliver bite-sized proof of concepts to ensure commitment to architecture and solutions will meet short, medium, and long-term goals.
— Shahbaz Hafeez, Senior Director Software Development, Kynetec
Project Details
Solutions
AWS Cloud, Infrastructure as Code, Continuous Integration , Serverless, Big Data
Technologies
Python, Scala, AWS RDS PostgreSQL, AWS RDS Aurora, AWS DynamoDB, AWS Lambda, AWS Glue, AWS IAM, AWS Batch, AWS Athena, AWS Step Functions, AWS SQS, AWS SNS, AWS CloudWatch, AWS S3, Apache Spark
Tools
Jenkins, Bitbucket, JIRA, Confluence, Docker, Terraform, Terragrunt
Team
3 developers, 1 Project Manager/Scrum Master
About the Client
Kynetec is the world leader in delivering market research to the agricultural sector. The company prides itself on providing best-in-class technologies and methodologies, building on a long history of continuous innovation. Kynetec delivers the highest, consistent standards in terms of quality, timeliness, privacy, integrity, and compliance.
Need a software solution?
Don’t hesitate to get in touch via the form below or at:
+48 71 798 2692
Let us know what you’re looking for.