Feed Dataset through Queue to Tensorflow from HDFS

Populate HDFS with Sample Dataset


In [ ]:
%%bash

hadoop fs -copyFromLocal /root/datasets/csv/ /csv

In [ ]:
%%bash

hadoop fs -ls /csv

Open a Terminal through Jupyter Notebook

(Menu Bar -> Terminal -> New Terminal)

Create Queue and Feed Tensorflow Graph

Run the Next Cell to Display the Code


In [ ]:
%%bash

cat /root/src/main/python/queue/tensorflow_hdfs.py

Run the following in the Terminal

queue_hdfs

In [ ]: