We're looking for engineers who can build scalable data pipelines, automation systems, and intelligent document processing solutions. You will work across the stack from browser automation and document extraction to event-driven backends and AI-driven document parsing solutions. You will be a core contributor to our high-growth product environment, designing distributed systems that ensure our platform remains performant and resilient as we scale.
Key Responsibilities:
β Architect & Build Scalable Systems: Design, develop, and maintain robust data pipelines and microservices using Python.
β Intelligent Document Processing: Develop document parsing and extraction pipelines (for PDFs, HTML, structured/unstructured data) that can reliably handle millions of documents.
β AI/ML Integration: Implement and leverage technologies like LLMs (Large Language Models), Langgraph, and Prompt Engineering to create advanced, AI-driven solutions.
β Data Strategy: Leverage NoSQL (specifically DynamoDB) and other database technologies to optimize data storage and retrieval for high-scale applications
β Stream Processing: Implement and manage real-time data streaming solutions using Kafka to support event-driven and responsive architectures.
β Cloud Infrastructure: Architect and deploy services within AWS, ensuring best practices in security, scalability, and cost-optimization.
β Code Excellence & Collaboration: Write clean, maintainable, and highly efficient code, lead rigorous code reviews, and actively collaborate with the team on system design and technical decision-making.
β System Optimization: Troubleshoot complex distributed systems issues and optimize performance across the entire tech stack.
β Mentorship: Act as a technical pillar for the team, mentoring junior engineers and fostering a culture of rapid experimentation and "failing fast" (and learning faster).
The Nielsen Company
https://careers.smartrecruiters.com/thenielsencompany