Mayflower is a technology company that alters the entertainment industry to a new level of perception and engagement.
Design and build data infrastructure from scratch;
Deploy and maintain VLogs / VMetrics;
Set up Iceberg Catalog;
Implement DataGov catalog;
Deploy Airflow on k8s and integrate with Spark;
Configure Spark History Server, Spark Connect, SparkOperator;
Deploy and administer Trino;
Migrate Tableau to new infrastructure;
Develop CI/CD Helm chart templates.
Important/challenging tasks:
Building a data platform entirely from scratch with no existing solutions — full ownership of architecture decisions;
Airflow + Spark integration on Kubernetes;
Tableau migration to the new infrastructure