Skip to main content

docker: storage and services

Docker Volume

Without going through Docker, accessing files within a Docker image is not easy. Therefore, Docker has a volume feature that allows users to specify the location on the host file system to serve as the access directory for Docker. In other words, a volume is the NFS of a Docker image.

Example: Using a volume to store SQLite files.

ref: 

SQLite for NodeJS: https://www.sqlitetutorial.net/sqlite-nodejs/

Initialize the project.

# Setup ExpressJS framework
express --view=pug 240324_ejs_sqlite_docker
npm init
npm install express
npm install sqlite3


Test:

npm start



Initialize docker 

Since the directory already contains NodeJS, the Docker Daemon will assist in the setup.



Create new docker image

docker build -t atfuture7/sqlite01 .

Create a folder for Docker, create a container, run it. 


  mkdir docker_vol
  docker run -p 3000:3000 -v ./docker_vol:/data --name exp_sqlite atfuture7/sqlite01


After confirming that the container can run correctly, stop the container and add content to the app.

Add sample project

This example chooses SQLite because SQLite is essentially just a file format and does not require any other application to run. It can be seen as a simple tool that only uses storage space and complies with the SQL language structure, making it well-suited for testing Docker's NFS.


Sample Web App:

sample code: https://github.com/atfuture7/testcode/tree/master/docker/02_docker_nfs

GitHub only contains all new and modified files. 
To make the new file runnable, it is necessary to install the module mod_story used for running SQLite.

npm install mod_story 

Rebuild Dock image and container


Operational: 

Since my PowerShell does not handle branches, commands are presented in the format I execute them.

  docker build -t atfuture7/sqlite01 .
  docker run  -p 3000:3000 -v ./docker_vol:/data --name exp_sqlite  atfuture7/sqlite01


After executing several additions at http://localhost:3000/idx2, the docker_vol/story.sqlite file can be seen in the execution directory.

* test/www is the entry point of the development environment, with the DB file set to (relative directory) ./docker_vol/story.sqlite.

* bin/www is the production environment, with the DB file set to (absolute directory) /data/story.sqlite.


Programmatic: 





Modify the compose.yaml file to add volume settings. By executing docker compose, the image and container can be built.

docker compose up --build


Docker services


The previous section is about creating your own image and the instructions for creating a container with compose.yaml. What the entry-point of a Docker image is, is determined by the Dockerfile settings. In other words, images pulled from the internet require developers to reveal the information needed to start the image. For complex control mechanisms, using compose would be easier.

Example: MySQL docker 

ref: 
https://www.datacamp.com/tutorial/set-up-and-configure-mysql-in-docker
https://hub.docker.com/_/mysql

Operational: 

docker run --name some-mysql -v ./docker_vol:/var/lib/mysql -e MYSQL_ROOT_PASSWORD=my-secret-pw -p 3306:3306 -d mysql

Programmatic: 


gitHub: https://github.com/atfuture7/testcode/tree/master/docker/03_docker_mysql



We will discuss the case of compose including several services next time. The example below shows the space occupied by the DB image. 





Comments

Post a Comment

Popular posts from this blog

Bookmark service (MongoDB & Spring REST) -2/2

    I accidentally deleted my development VM. I got lucky having the habit of taking notes. This blog is useful. Development VM is doom to be lost. Rebuild it waste time, but having a clean slate is refreshing~. What concerns me more is my AWS free quota this month is reaching 85%. The second VM I launched but never being used might be the one to blame. (Of course, my mistake.) I terminated the wrong VM. Now I got Linux 2 built. Great, just threw away everything happened on AMI.  1st layer: Page Page class   Originally, I need to prepare getter/setter for all class properties for Spring. By using lombok, I only need to create constructors. lombok will deal with getter/setter and toString(). But there are chances to call getter/setter, but how? .......Naming convention.... Capitalize the 1st character with the prefix get/set.  Annotation @Data was used on this class.  Repository class Spring Docs: Repository https://docs.spring.io/spring-data/mongodb/docs/3....
1 comment
Read more

Guide to Preserving HuggingFace Models in Google Colab Environments

Conclusion:  Step 1:  find the model path: ls ~/.cache  Step 2:  Copy the entire folder to Google Drive:  Step 3:  Set model path to the subfolder under snapshot: My Story: I initially began exploring Generative AI (GAI) and Google Colab through Stable Diffusion. In the past, as I mainly wrote server services and console applications, I was less familiar with data science modes like R and Jupyter that can maintain a paused state. I didn't quite understand the heavy burden on Colab of creating a temporary Stable Diffusion WebUI with .ipynb, as suggested by popular guides. I just found it troublesome that connections often took a long time and then dropped, requiring a restart. Recently, while testing new versions of the Stable Diffusion model, and facing challenges due to Colab's policies making various versions of WebUI difficult to run successfully, I started researching how to write my own test programs in Colab. Eventually, I understood that Colab is ess...
Post a Comment
Read more

Setup Maven and two basic projects

    The interesting implementation of Java I proceed to is Spring. And, only getting Java running is not enough. I also need to set up Maven. This name is new to me, and I found many Spring tutorials just skip this part. At least I need Maven to generate templates for me. I should learn it more. ( I knew there is a great tool -- Eclipse -- can make tedious things disappear. I’m taking a strategy to install all experiments I want to try and throw away when it's full. And that's an external VM, not my PC. I, not yet, want to do research about installing Eclipse on AMI. )    Upgrade to Java 8     First is to upgrade Java on AMI to Java8. AWS provides advanced tools for Linux 2. And DIY for Linux2. At least there are solutions for my choice.  Amazon Corretto 8 Installation Instructions for Amazon Linux 2 https://docs.aws.amazon.com/corretto/latest/corretto-8-ug/amazon-linux-install.html Here are commands I used: >wget */amazon-corretto-8-x64-linux-jdk.d...
Post a Comment
Read more