Menu

Data Science Dev

Design, develop, deploy

Blog posts

Git Commands

Create a Repository (HTTP)

git clone http://<server address>/<username>/<repository>.git
cd <folder>
touch README.md
git add README.md
git commit -m "add README"
git push -u origin master

 

Existing Folder (HTTP)

cd existing_folder
git init
git remote add origin http://<serve…

Read more

Single Control-Plane Cluster with Kubernetes

 

Single Control-Plane Cluster with Kubernetes

Objective: Install Kubernetes on a Single Machine divided into Three Virtual Box Nodes with Single Control-Plane.

References:

  1. https://medium.com/@KevinHoffman/building-a-kubernetes-cluster-in-virtualbox-with-ubuntu-22cd338846dd
  2. https://kub…

Read more

Install Tensorflow 1.14.0 on Raspberry Pi 3+ with Python 3.6.8

1. sudo su

2. apt install libhdf5-dev

3. python3.6 -m pip install --upgrade pip setuptools

4. python3.6 -m pip install --upgrade six

5. python3.6 -m pip install tensorflow==1.14.0

6. sudo nano /etc/dphys-swapfile

7. change CONF_SWAPSIZE=100 to CONF_SWAPSIZE=2048 an exit nano

8. sudo /etc/init…

Read more

Install Python 3.6.8 on Raspberry Pi 3+

1. sudo apt update

2. sudo apt install -y build-essential tk-dev libncurses5-dev libncursesw5-dev libreadline6-dev libdb5.3-dev libgdbm-dev libsqlite3-dev libssl-dev libbz2-dev libexpat1-dev liblzma-dev zlib1g-dev libffi-dev

3. wget https://www.python.org/ftp/python/3.6.8/Python-3.6.8.tgz

4. sudo…

Read more

Installing Python Libraries on Jetson TX2 / Jetpack 4.2.2

Just a reminder for me on the steps to install certain libraries on Jetson TX2 with Jetpack 4.2.2.

1. Install Jetpack 4.2.2 with Tensorflow 1.14 checked.

2. sudo apt update

3. sudo apt install -y libblas-dev liblapack-dev git cmake gfortran libatlas-base-dev libfreetype6-dev  

4. sudo apt autor…

Read more

Tools to Annotate Images

Here is a link to many manual tools for labeling and annotating images. 

https://en.wikipedia.org/wiki/List_of_manual_image_annotation_tools

Ratsnake seems good for image segmentation.

 

 

Read more

Docker on Ubuntu Tutorial

I experimented with Docker lately.  Here are a few commands, notes and issues I resolved while working on Ubuntu 16.04.  I'm assuming you have docker installed (sudo apt-get update && apt-get install docker-ce)


Tutorial on the web for "dockerizing" python applications.https://runnable.c…

Read more

CNN + RNN TensorFlow Example Code

This is example code for a CNN + RNN structure used for analyzing time-series data.    There is a separate CNN structure for each time step of windowed data.  The RNN learns the time dependency between feature vectors extracted by the CNNs. 

import tensorflow as tf
im…

Read more

Installing Tensorflow 1.3 / CUDA Toolkit 8.0 / cuDNN 6.0 on ASUS GL502VS-DS71 Laptop with Ubuntu 16.04 and Nvidia 1070

Image result for gl502vs-ds71

My ASUS GL502VS-DS71 laptop had some operating system problems recently so I decided to reinstall Ubuntu on it.  Somehow the Nvidia driver got updated to a more recent version (384.90) that didn't work with Tensorflow.  This is an excellent opportunity to refresh the installation procedure of Tens…

Read more

Installing Jetpack 3.1 on Jetson TX2 with Tensorflow 1.3 / Keras / hdf5 (.h5)

1. Download Jetpack 3.1 runfile from here on Host PC.

2. Run the installer "./JetPack-L4T-3.1-linux-x64.run" from terminal (you may need to navigate directory to location where downloaded).

3. Follow prompts and instructions to install.  The download may take a while and after it has completed,…

Read more

Flask / Windows IIS Setup

I wrote a little manual to help me remember how to setup Windows IIS with Python / Flask / WSGI to get a Web app going.  You can get it here

Read more

Multithreading TensorFlow / Keras Models

I made an example (with some code borrowed from the Web) of how you can multithread TensorFlow models in Python.  The key I found was to wrap any execution of a model predict function in a lock.  Here is a link to the files.  This is not for training of different models in parallel--only for af…

Read more

Install Tensorflow 1.3 / Keras on Ubuntu 16.04 with NVIDIA 1080 Ti / Titan X

Note: These directions are subject to change, but worked for me on 8/12/2017 on a Intel 4-core CPU desktop.

1. Remove NVIDIA card from computer and plug Display/HDMI cable to the connector provided by motherboard.

2. Reboot computer and get into BIOS (delete/DEL key while restarting or other key…

Read more

Cython Example

This is a simple Cython example I made from another website's tutorial.  I remember when I was trying to extend Python functionality with C.  It wasn't too bad, but Cython makes it a lot easier.  Here are the files for the example.

1. Install Cython: “pip install cython” from windows comma…

Read more

Install VNC on Ubuntu 16.04

VNC or Virtual Network Computing is a tool I like to use when I want to "remote desktop" into my Ubuntu machine.

1. sudo apt-get install vnc4server

2. sudo apt-get install gnome-session gnome-panel metacity nautilus gnome-terminal

3. type 'vncserver' and enter password

4. sudo nano ~/.vnc/xst…

Read more

Making a Small Raspberry Pi Hadoop / Spark / Yarn / Hive Cluster

Sometimes the best learning comes from doing.  I put together a small Raspberry Pi cluster a while ago to try and learn more about Hadoop and Spark.  The result is this tutorial to help set one up.  It may be a little dated, but maybe it will help some folks get started.

Read more

16 blog posts

Blog Search

Comments

There are currently no blog comments.