Sep 16, 2020Data Pipeline for Data Science, Part 1: Problem/Solution FitLearn how to create Data Pipeline for Data Science through a step-by-step series that covers the end-to-end delivery of a Data Engineering Solution employing Tensorflow, Amazon S3, Redshift, EC2 and Apache Airflow. Wanna hear occasional rants about Tensorflow, Keras, DeepLearning4J, Python and Java?Data Pipeline8 min read
Sep 16, 2020Member-onlyData Pipeline for Data Science, Part 2: TMDb API Data“Crawler”Distributed TMDb API Data Download using AWS Lambda. Wanna hear occasional rants about Tensorflow, Keras, DeepLearning4J, Python and Java?Tmdb7 min read
Sep 16, 2020Member-onlyData Pipeline for Data Science, Part 3: Infrastructure As CodeDeploying AWS EC2 Machines, AWS Redshift, Apache Airflow using a a repeatable interactive process coded into an explanatory Jupyter Notebook. Wanna hear occasional rants about Tensorflow, Keras, DeepLearning4J, Python and Java?AWS9 min read
Sep 16, 2020Member-onlyData Pipeline for Data Science, Part 4: Airflow & Data PipelinesDeploy Operators and DAGs to a AWS hosted Apache Airflow and execute your Data Pipelines with DAG and Data Lineage Visualisation. Wanna hear occasional rants about Tensorflow, Keras, DeepLearning4J, Python and Java?Airflow5 min read
Jun 24, 2020Member-onlyWhat exactly is a Deep Learning Model?Non-data scientists often use the word Model to mistakenly refer to the what in Machine Learning we canonically call Model Architecture. And it couldn't be more wrong! Wanna hear occasional rants about Tensorflow, Keras, DeepLearning4J, Python and Java?Deep Learning7 min read
Apr 16, 2020Robo 3T, Dangerous default value for "Create Index in Background"Indexes in mongo must be created in Background. Not doing it is dangerous enough to bring your entire MongoDB cluster down, and beyond repair. Problem Create and index, followed by any modification to the index in a large collection with the Advanced > Create Index in Background option set to false. …Mongodb3 min read
Apr 15, 2020Push your JAR to MavenCentralSee the breadcrumbs (and scripts) I left on the way to publish your opensource JAR to MavenCentral via Sonatype Central. Background I currently work as a Lead Software Engineer at AIQUDO, Voice to Action (former Boxfish & Sofia Discovery) in the UK division. And for over a year I have contributed…Maven4 min read
Nov 15, 2018Member-onlyImmutable, the Builder Pattern vs Messy POJOs (or POCOs)Learn how these design patterns made famous by the GoF (Gang of Four) can help you achieve more reliable and cleaner code. One of the 3 line of codes has a _bad bad_ bug. Can you tell? 1. new Phrase(“how are you?”, “en-US”); 2. new Phrase() .setText(“how are you?”) .setLocale(“en-US”); …Java3 min read
Nov 13, 2018Comparator<> vs Compartor.comparing when sorting Java StreamsReduce the amount of comparators you have using Comparator.comparing(). When implementing sorting logic, it’s common to choose one out of the 2 routes: (a) use implementations of Comparator<> (b) use lambdas Although these are still good approaches, there is a very handy factory method in the Comparator interface that can…Programming2 min read
Aug 18, 2018SOLVED: System.Drawing .NETCore on Mac, GDIPlus ExceptionJust caught a GDI+ error running System.Drawing on a Mac? Maybe I got what you need here, to solve it in 5 secs. Context If you are trying to generate thumbnails on .NETCore, you probably have come across of the porting of the System.Drawing namespace into mono. If you haven't, check…Aspnet2 min read
