Working around AWS Lambda's limits with Ansible*
This talk would explain how we used Ansible's master-slave provisioning orchestration to work around AWS Lambda's limits.
AWS Lambda has very restrictive limitations when it comes to time limits and also memory limits, which makes doing complex Machine Learning difficult.
However, we worked around it with the Master-Workers provisioning orchestration abilities of the open source tool, Ansible for designing a reliable, serverless, batch processing data pipeline infrstructure.
Also, thanks to the self-destruction abilities of EC2+Ansible
aws, ansible, Serverless
I am speaking at FOSS Asia 2017 this March, and that would be my first speaking experience at conferences. Apart from that, I speak regularly at Pydata Delhi and ML India, Mumbai where I'm also the organizer.
Senior Data Scientist at Episource.
Data Science by day, Devops and Distributed Systems by night. Writes shitty books.