Senior Data Engineer in ClickIT Smart Technologies

ClickIT: DevOps and Software Development is a Cloud and DevOps Agency who has developed cloud based solutions for almost 10 years, for customers from all around the world. Our core competencies are Financial Services, Healthcare, MarTech, Ecommerce, Big Data & Analytics and our Experience comes with startups and mid-large enterprises. We are AWS and GCP certified partners with an experience of helping more than 200 product and service-centric companies based out of the US with their cloud migration and DevOps initiatives. This position its to be part of our team.

We are seeking a highly motivated and experienced Senior Data Engineer to join our team and help us build and maintain our cutting-edge Crypto Insights Platform.
As a Senior Data Engineer, you’ll be responsible for ensuring the robustness and scalability of our platform’s data ingestion and exchange systems, as well as managing and optimizing our data pipeline for text data.

• Design, build, and maintain data exchange and ingestion systems using Python, Fast API, Object-Oriented Programming (typing), and Dynamo
• Develop and implement web scraping techniques to extract relevant data from unstructured sources.
• Manage and optimize the data pipeline for text data, including parsing, cleaning and storing text data, and applying NLP techniques to extract insights.
• Build and maintain web socket HTTP connections with various exchanges to ensure the timely and accurate delivery of data.
• Design and implement unit testing frameworks to ensure the reliability and robustness of data ingestion and exchange systems.
• Work closely with the development team to ensure that data is properly integrated into the platform and delivered to end-users in a timely and accurate manner.

• Bachelor’s Degree in Computer Science or related field.
• Minimum of 5 years of experience in Python, with a focus on data exchange and ingestion.
• Proven experience with Object-Oriented Programming (typing), Fast API, Dynamo, and Async IO.
• Familiarity with web socket HTTP and web scraping techniques.
• Experience with text handling, data management for text, and NLP techniques.
• Experience in designing and implementing unit testing frameworks.
• Excellent communication and problem-solving skills.

• Familiarity with Redis, AWS, monitoring health, and reporting routes of data.
• Experience with dashboarding and visualizing health monitoring data.
• Knowledge of statistics.

• Fully Remote: flexible hours and 100% home office
• Safety Wing: medical Insurance
• Biweekly payment: through Deel
• Vacations days since month 3: 6 days for every 6 months
• Referral bonus: $200 USD for each referral that lasts 3 months
• Certifications and Courses: 100% of the cost covered by the company
• Salary review: every 6 months from the date of entry and for certifications
• English classes: up to 3 hours of conversational classes per week totally virtual
• Wellness Program: up to 5 monthly sessions available on Terapify, E-books and online yoga sessions
• Integration activities: remote integration activities with a chance to win great prizes
• Recognition program: recognition for completion of projects
• ClickIT Academy: opportunity to give conferences
• Career plan: design of a career plan after 6 months at the company
• Bonus for personal use of computer equipment: $50 USD per month