Kynetec: 4x Faster Processing Times Thanks to Improved Automation

To optimize data processing times, Kynetec moved their solution to a serverless architecture and replaced relational databases with Cloud-based solutions with better horizontal scaling.

Scroll down for more

Business Benefits

The initial MVP used a cloud-managed SQL database service as the main data processing platform. This was transitioned to a file-based storage service, using serverless features where feasible to minimize the resource footprint when not in use. Raw data can now be cleaned significantly faster and more efficiently, enabling Analysts to spend more time creating value-added insights.

    • With Managed Spark Computing clusters, average raw data processing times were reduced by 77%.
    • Effective processes allowed Data Analysts to spend more time producing richer insights

Results by Numbers

77%

77% Increased Data Processing Efficiency

Business Need

Kynetec processes large amounts of raw data to create industry reports for their clients. Working on such sizable data volumes, to some extent manually, took up a lot of their Analysts’ time. After implementing an MVP – the first step to introducing automation – Kynetec decided to further expand their new solution to free up Data Analysts to work on more meaningful tasks.

photo of quoting person

PGS Software plays a pivotal role in us meeting our objectives against automating and enhancing our Data Pipelines. The value-driven approach ensures changes are prioritised and where the effort may be significant, PGS Software deliver bite-sized proof of concepts to ensure commitment to architecture and solutions will meet short, medium, and long-term goals.

Shahbaz Hafeez, Senior Director Software Development, Kynetec

Project Details

solutions icon

Solutions

AWS Cloud, Infrastructure as Code, Continuous Integration , Serverless, Big Data

technologies icon

Technologies

Python, Scala, AWS RDS PostgreSQL, AWS RDS Aurora, AWS DynamoDB, AWS Lambda, AWS Glue, AWS IAM, AWS Batch, AWS Athena, AWS Step Functions, AWS SQS, AWS SNS, AWS CloudWatch, AWS S3, Apache Spark

tools icon

Tools

Jenkins, Bitbucket, JIRA, Confluence, Docker, Terraform, Terragrunt

team icon

Team

3 developers, 1 Project Manager/Scrum Master

About the Client

client logo

Kynetec is the world leader in delivering market research to the agricultural sector. The company prides itself on providing best-in-class technologies and methodologies, building on a long history of continuous innovation. Kynetec delivers the highest, consistent standards in terms of quality, timeliness, privacy, integrity, and compliance.

Need a software solution?

Don’t hesitate to get in touch via the form below or at:

+48 71 798 2692

Let us know what you’re looking for.