Chaoran Liu

Chaoran Liu

A data science enthusiast

Recent posts

Implement DeepFM model in Keras

8 minute read

Introduction Wide and deep architect has been proven as one of deep learning applications combining memorization and generatlization in areas such as search and recommendation. Google released its wide&deep learning in 2016. wide part: helps to memorize the past behaviour for specific choice deep part: embed into low dimension, help to discover new user, product combinations Later, on top of wide & deep learning, deepfm was developed combining DNN model and Factorization machi...

Set up Superset on ubuntu 16.04 LTS

1 minute read

Apache Superset (incubating) is a modern, enterprise-ready business intelligence web application. Compared with business-focused BI tool like Tableau, superset is more technology-navy. It supports more types of visualization and able to work in distributed manner to boost the query performance. Most importantly, it is free of charge! An example dashboard: Let’s go and set it up. create a virtualenv Assume Anaconda is installed for python management. # create a virtualenv with python ...

Not so basic Keras tutorial for R

3 minute read

The basic tutorial of Keras for R is provided by keras here, which simple and fast to get started. But very soon, I realize this basic tutorial won’t meet my need any more, when I want to train larger dataset. And this is the tutorial I’m going to discuss about keras generators, callbacks and tensorboard. Keras Installation If you haven’t got your keras in R, just follow the steps at below: devtools::install_github("rstudio/keras") library(keras) install_keras() MNIST handwriting recogniti...

It’s time to upgrade your scheduler to Airflow

4 minute read

Airflow is an open source scheduling tool, incubated by Airbnb. Airflow is now getting popular and more Tech companies start using it. Compared with our company’s existing scheduling tool - crontab, it provides advantageous features, such as user-friendly web UI, multi-process/distributed executions,notification when failure/re-try. In this post, I’m going to record down my journey of airflow setup. Content 1.Install Airflow 2.Configure Airflow 3.Choices of Executors 4.Final Note...

Shiny + shinydashboard + googleVis = Powerful Interactive Visiualization

4 minute read

If you are a data scientist, who spent several weeks on developing a fantanstic model, you’d like to have an equally awesome way to visualize and demo your results. For R users, ggplots are good option, but no longer sufficient. R-shiny + shinydashboard + googleVis could be a wonderful combination for a quick demo application. For the purpose of illustration, I just downloaded a random sample data test.csv from kaggle’s latest competitions: https://www.kaggle.com/c/new-york-city-taxi-fare-pre...