etl

AWS Serverless ETL Framework

SoftB*nk Robotics, 2018

The idea is to take advantage of

SERVERLESS

concept to gain more time for the data analysis work. Every big data company spends more than 70% of the time for ETL jobs; however, only does

the data analysis work (BI, ML, DL)

bring the real business value to the products and to the company.

  • AWS Serverless ETL Framework
  • SoftB*nk Robotics
  • 2018
  • Senior Data Engineer
  • Team of 3 data engineers
  • TParis, Île-de-France, France
  • Extract, Transform, Load (ETL)
  • Python 2.*
  • AWS Glue
  • AWS RDS
  • AWS Redshift
  • AWS S3
  • PostgreSQL
  • Data Lake
  • Data Warehouse
  • PySpark
  • Git
  • Pylint