We’re Ai Palette. We think the world would be a nicer place to be if food companies could create products that the consumers really want. So we’re making it happen. After a successful 1.5 million SGD seed round in 2019, we have scaled fast in the market having Fortune 500 companies and FMCG brands as our clients. We’re already covering the major markets in APAC and the USA. We want to be the most preferred Food AI company in the world.
Internship Project :
Extract, Transform, Load in Foresight Engine
Project Description and Objectives:
The objective of this project is to improve the ETL process in our foresight engine. We collect millions of unstructured data from various sources including social media, recipe databases and online ecommerce platforms.
Processing multiple data streams on the cloud infrastructure is important to generate actionable insights in time at scale. As a data engineer, you will be working on stream data processing using cloud tools, writing custom scripts (python) to clean and process data for downstream tasks, use monitoring and visualisation tools to manage the data ingestion and analytics.
Roles and Responsibilities:
Responsibilities
1. Research on state of the art stream processing frameworks
2. Automate ETL pipeline with the help of DevOps team
3. Write custom analytical queries
4. Use visualization tools to manage the ETL pipeline
5. Work with insights team to generate custom analytics
Preferred Skills:
Algorithms
Python
SQL + NoSQL
Cloud technologies
Good to have:
Kafka
Elasticsearch
Django
Mentor:
Kasun Perera : https://www.linkedin.com/in/kasunsp/
Former Mentee Feedbacks:
[1] https://medium.com/geekculture/my-data-science-internship-the-start-up-experience-5af69abe4b43
[2] https://www.linkedin.com/pulse/eye-opening-experience-fintech-company-bryan-lim-yuqiang/
Related Job Searches:
- Company:
Ai Palette - Designation:
Intern - Data Engineer - Profession:
IT / Information Technology - Industry:
Computer and IT