Menu

Data Science Dev

Design, develop, deploy

Blog posts : "General"

Tools to Annotate Images

Here is a link to many manual tools for labeling and annotating images. 

https://en.wikipedia.org/wiki/List_of_manual_image_annotation_tools

Ratsnake seems good for image segmentation.

 

 

Read more

Docker on Ubuntu Tutorial

I experimented with Docker lately.  Here are a few commands, notes and issues I resolved while working on Ubuntu 16.04.  I'm assuming you have docker installed (sudo apt-get update && apt-get install docker-ce)


Tutorial on the web for "dockerizing" python applications.https://runnable.c…

Read more

State Space Reconstruction from Time Series Data - Embedding Dimension - Time Delay

I was experimenting with some features related to state space reconstruction trying to determine when a fault occurs from time series data.  Thought I would keep it here in case I needed to refer to it later.  The features are time delay and embedding dimension.  The code is below with Lorenz model…

Read more

CNN + RNN TensorFlow Example Code

This is example code for a CNN + RNN structure used for analyzing time-series data.    There is a separate CNN structure for each time step of windowed data.  The RNN learns the time dependency between feature vectors extracted by the CNNs. 

import tensorflow as tf
im…

Read more

Installing Tensorflow 1.3 / CUDA Toolkit 8.0 / cuDNN 6.0 on ASUS GL502VS-DS71 Laptop with Ubuntu 16.04 and Nvidia 1070

Image result for gl502vs-ds71

My ASUS GL502VS-DS71 laptop had some operating system problems recently so I decided to reinstall Ubuntu on it.  Somehow the Nvidia driver got updated to a more recent version (384.90) that didn't work with Tensorflow.  This is an excellent opportunity to refresh the installation procedure of Tens…

Read more

Installing Jetpack 3.1 on Jetson TX2 with Tensorflow 1.3 / Keras / hdf5 (.h5)

1. Download Jetpack 3.1 runfile from here on Host PC.

2. Run the installer "./JetPack-L4T-3.1-linux-x64.run" from terminal (you may need to navigate directory to location where downloaded).

3. Follow prompts and instructions to install.  The download may take a while and after it has completed,…

Read more

Flask / Windows IIS Setup

I wrote a little manual to help me remember how to setup Windows IIS with Python / Flask / WSGI to get a Web app going.  You can get it here

Read more

Multithreading TensorFlow / Keras Models

I made an example (with some code borrowed from the Web) of how you can multithread TensorFlow models in Python.  The key I found was to wrap any execution of a model predict function in a lock.  Here is a link to the files.  This is not for training of different models in parallel--only for af…

Read more

Install Tensorflow 1.3 / Keras on Ubuntu 16.04 with NVIDIA 1080 Ti / Titan X

Note: These directions are subject to change, but worked for me on 8/12/2017 on a Intel 4-core CPU desktop.

1. Remove NVIDIA card from computer and plug Display/HDMI cable to the connector provided by motherboard.

2. Reboot computer and get into BIOS (delete/DEL key while restarting or other key…

Read more

Cython Example

This is a simple Cython example I made from another website's tutorial.  I remember when I was trying to extend Python functionality with C.  It wasn't too bad, but Cython makes it a lot easier.  Here are the files for the example.

1. Install Cython: “pip install cython” from windows comma…

Read more

Install VNC on Ubuntu 16.04

VNC or Virtual Network Computing is a tool I like to use when I want to "remote desktop" into my Ubuntu machine.

1. sudo apt-get install vnc4server

2. sudo apt-get install gnome-session gnome-panel metacity nautilus gnome-terminal

3. type 'vncserver' and enter password

4. sudo nano ~/.vnc/xst…

Read more

Making a Small Raspberry Pi Hadoop / Spark / Yarn / Hive Cluster

Sometimes the best learning comes from doing.  I put together a small Raspberry Pi cluster a while ago to try and learn more about Hadoop and Spark.  The result is this tutorial to help set one up.  It may be a little dated, but maybe it will help some folks get started.

Read more

12 blog posts