[Remote] Sr. Software and Data Engineer (API)

Note: The job is a remote job and is open to candidates in USA. Affinity Solutions is the leading consumer purchase insights company, providing a complete view of U.S. and U.K. consumer spending. They are seeking a Senior Data and Software Engineer to architect, build, and maintain high-performance RESTful APIs for their data integration ecosystem.

Responsibilities

• Design, develop, and maintain high-performance RESTful APIs that handle large-scale data operations with optimal efficiency and minimal latency
• Stay current with emerging API technologies, standards, and best practices, including GraphQL, gRPC, OpenAPI 3.0+, and modern authentication/authorization frameworks
• Implement performance optimization strategies for APIs, including caching, rate limiting, pagination, and asynchronous processing, to ensure scalability and reliability
• Integrate with third-party API vendors and external systems, managing authentication, data transformation, and error handling, and ensuring seamless interoperability
• Develop comprehensive API documentation using industry standards (Swagger/OpenAPI) and implement robust monitoring, logging, and observability solutions
• Design and implement data privacy features and services to enable secure multi-party collaboration, including query constraints, data clean room construction, deployment, and monitoring at scale
• Uphold data governance standards and practices, ensuring compliance with data quality standards
• Implement and enforce data security measures to protect sensitive data, including personally identifiable information (PII) and financial data
• Leverage SQL and Python programming proficiency to extract, transform, clean, and interpret large data volumes (200BIL+ records)
• Design highly performant data structures to ensure optimal storage and retrieval of data
• Utilize advanced database technologies to enhance data storage and processing capabilities
• Participate in code reviews to maintain code quality and consistency; collaborate with the infrastructure team to plan and execute deployments
• Lead and manage integration projects, including: LiveRamp XMI Integration and Salesforce integration, Additional clean rooms (AWS/AMC) modeling integration, CAPI integrations with walled gardens on behalf of brands, MadConnect integration pipes and buildout, Opening new integration channels based on client demand

Skills

• Extensive experience building production-grade RESTful APIs with proven expertise in API design patterns, versioning strategies, and backward compatibility
• Deep understanding of API performance optimization techniques, including query optimization, connection pooling, request batching, and response compression
• Strong knowledge of modern API technologies and standards, including OpenAPI/Swagger specifications, OAuth 2.0, JWT, GraphQL, and API gateway patterns
• Demonstrated success integrating with external API vendors and managing complex API ecosystems with multiple third-party dependencies
• Experience with API testing frameworks, contract testing, and implementing comprehensive API monitoring and alerting systems
• 6 or more years of experience as a back-end data/software engineer working on various data technologies, with proficiency in SQL, Python, and Javascript (Node.js)
• 2 or more years of hands-on experience with Snowflake ecosystem, including expert knowledge of SnowPipes, Streams, Views, performance tuning, data modeling, ELT pipelines, data visualizations, and standard DWH concepts, and experience implementing complex SQL stored procedures
• Minimum 3 years' experience with various AWS cloud technologies and data lake management such as S3, Lambda, Airflow, Redshift, Athena, and Glue
• Demonstratable knowledge of data clean room technologies (e.g., creating secure data shares using RBAC). Knowledge of Snowflake Native apps (v6+) preferred
• Knowledge of all aspects of the SDLC as well as experience with Jenkins and setting up CI/CD processes
• Experience with security concepts such as CCPA, GDPR, SSO, and JWT
• Proficiency in data access controls, including aggregation constraints, projection policies, row access policies, column masking, and differential privacy; knowledge of data controls including semantic models, dbt, honeydew, Iceberg tables, various catalogs (glue, rest, nessie, hadoop etc), and catalog syncing concepts
• Experience with cloud environments such as SNOWFLAKE, AWS, DATABRICKS, LIVERAMP, and GCP
• Familiarity with BI tools such as Thoughtspot, Sigma, Domo, Looker, Quicksights, Tableau; detailed knowledge of AI concepts such as Generative AI chatbots, cortex analyst, agent training, various LLMs, and prompt engineering
• Experience in modeling: Snowpark ML, TensorFlow
• Expert-level experience building, maintaining, and scaling APIs using Node.js, Express, Fastify, or similar frameworks; proficiency with Swagger/OpenAPI specifications, API documentation tools, Next.js, and modern API development practices

Benefits

• Benefits for full-time employees of Affinity Solutions begin on the first of the month following your date of hire with a generous employer contribution for medical, dental, and vision
• Company paid holidays
• Wellness time off
• Other wellness benefits
• Employee discounts
• Employer paid life insurance
• Option to enroll into an employer-matched 401K Plan
• Unlimited vacation days, available starting 90 days from your hire date as a team member

Company Overview

Company H1B Sponsorship