Data Engineer (Streamlit Expertise)

Develop scalable data collection, storage, and distribution platform to house data from vendors, research providers, exchanges, PBs, and web-scraping. Make data available to systematic & fundamental PMs, and enterprise functions: Ops, Risk, Trading, and Compliance. Develop internal data products and analytics

Responsibilities

• Web scraping using scripts/APIs/Tools
• Help build and maintain greenfield data platform running on Snowflake and AWS
• Understand the existing pipelines and enhance pipelines for the new requirements.
• Onboarding new data providers
• Data migration projects

Skills

• SQL
• senior level
• Python
• senior level
• Streamlit Expertise
• Linux
• Containerization (Docker, Kubernetes)
• Good communication skills
• AWS
• Dev ops skills (K8s, Docker, Jenkins)

Nice to have

• Market Data Projects/ Capital markets exp
• Snowflake is a big plus
• Airflow