Alexander Kolotov
3a8e9f4e66
|
2 months ago | |
---|---|---|
.. | ||
bin | 2 months ago | |
.blockscout_config.example | 2 months ago | |
Dockerfile | 2 months ago | |
README.md | 2 months ago | |
devcontainer.json | 2 months ago | |
docker-compose.yml | 2 months ago |
README.md
Blockscout Backend Development with VSCode Devcontainers and GitHub Codespaces
Table of Contents
- Motivation
- Setting Up VSCode Devcontainer Locally
- Using GitHub Codespaces in the Browser
- Configuring Postgres DB Access
- Developing Blockscout Backend
- Upgrading Elixir Version
- Contributing
Motivation
Setting up a local development environment for Blockscout can be time-consuming and error-prone. This devcontainer setup streamlines the process by providing a pre-configured environment with all necessary dependencies. It ensures consistency across development environments, reduces setup time, and allows developers to focus on coding rather than configuration.
Key benefits include:
- Pre-configured environment with Elixir, Phoenix, and Node.js
- Integrated PostgreSQL database
- Essential VS Code extensions pre-installed
- Simplified database management
- Consistent development environment across team members
Setting Up VSCode Devcontainer Locally
-
Clone the Blockscout repository:
git clone https://github.com/blockscout/blockscout.git cd blockscout
-
Open the project in VS Code:
code .
-
Before re-opening in the container, you may find it useful to configure SSH authorization. To do this:
a. Ensure you have SSH access to GitHub configured on your local machine.
b. Open
.devcontainer/devcontainer.json
.c. Uncomment the
mounts
section:"mounts": [ "source=${localEnv:HOME}/.ssh/known_hosts,target=/home/vscode/.ssh/known_hosts,type=bind,consistency=cached", "source=${localEnv:HOME}/.ssh/config,target=/home/vscode/.ssh/config,type=bind,consistency=cached", "source=${localEnv:HOME}/.ssh/id_rsa,target=/home/vscode/.ssh/id_rsa,type=bind,consistency=cached" ],
d. Adjust the paths if your SSH keys are stored in a different location.
-
When prompted, click "Reopen in Container". If not prompted, press
F1
, type "Remote-Containers: Reopen in Container", and press Enter. -
VS Code will build the devcontainer. This process includes:
- Pulling the base Docker image
- Installing specified VS Code extensions
- Setting up the PostgreSQL database
- Installing project dependencies
This may take several minutes the first time.
-
Once the devcontainer is built, you'll be working inside the containerized environment.
-
If you modified the
devcontainer.json
file in step 3, you may want to executegit update-index --assume-unchanged .devcontainer/devcontainer.json
in a terminal within your devcontainer to prevent the changes todevcontainer.json
from appearing ingit status
and VS Code's Source Control.
Additional Setup for Cursor.ai Users
If you're using Cursor.ai instead of VSCode, you may need to perform some additional setup steps. Please note that these changes will not persist after reloading the devcontainer, so you may need to repeat these steps each time you start a new session.
-
Git Configuration: You may encounter issues when trying to perform Git operations from the terminal or the "Source Control" tab. To resolve this, set up your Git configuration inside the devcontainer:
a. Open a terminal in your devcontainer. b. Set your Git username:
git config --global user.name "Your Name"
c. Set your Git email:
git config --global user.email "your.email@example.com"
Replace "Your Name" and "your.email@example.com" with your actual name and email associated with your GitHub account.
-
ElixirLS: Elixir support and debugger (JakeBecker.elixir-ls): This extension may not be automatically installed in Cursor.ai, even though it's specified in the devcontainer configuration. To install it manually:
a. Open the Extensions tab. b. Search for "JakeBecker.elixir-ls". c. Look for the extension "ElixirLS: Elixir support and debugger" by JakeBecker and click "Install".
Remember, you may need to repeat these steps each time you start a new Cursor.ai session with the devcontainer.
Signing in to GitHub for Pull Request Extension
- In the devcontainer, click on the GitHub icon in the Primary sidebar.
- Click on "Sign in to GitHub" and follow the prompts to authenticate.
Using GitHub Codespaces in the Browser
To open the project in GitHub Codespaces:
- Navigate to the Blockscout repository on GitHub.
- Switch to the branch you want to work on.
- Click the "Code" button.
- Instead of clicking "Create codespace on [branch]" (which would use the default machine type that may not be sufficient for this Elixir-based project), click on the three dots (...) next to it.
- Select "New with options".
- Choose the "4-core/16GB RAM" machine type for optimal performance.
- Click "Create codespace".
This will create a new Codespace with the specified resources, ensuring adequate performance for the Elixir-based project.
Note: After the container opens, you may see an error about the inability to use "GitHub Copilot Chat". This Copilot functionality will not be accessible in the Codespace environment.
Configuring Postgres DB Access
To configure access to the PostgreSQL database using the VS Code extension:
- Click on the PostgreSQL icon in the Primary sidebar.
- Click "+" (Add Connection) in the PostgreSQL explorer.
- Use the following details:
- Host:
db
- User:
postgres
- Password:
postgres
- Port:
5432
- Use an ssl connection: "Standard connection"
- Database:
blockscout
- The display name: ""
- Host:
These credentials are derived from the DATABASE_URL
in the bs
script.
Developing Blockscout Backend
Configuration
Before running the Blockscout server, you need to set up the configuration:
- Copy the
.devcontainer/.blockscout_config.example
file to.devcontainer/.blockscout_config
. - Adjust the settings in
.devcontainer/.blockscout_config
as needed for your development environment.
For a comprehensive list of environment variables that can be set in this configuration file, refer to the Blockscout documentation.
Using the bs
Script
The bs
script in .devcontainer/bin/
helps orchestrate common development tasks. Here are some key commands:
- Initialize the project:
bs --init
- Initialize or re-initialize the database:
bs --db-init
(This will remove all data and tables from the DB and re-create the tables) - Run the server:
bs
- Run the server without syncing:
bs --no-sync
- Recompile the project:
bs --recompile
(Use this when new dependencies arrive after a merge or when switching to anotherCHAIN_TYPE
) - Run various checks:
bs --spellcheck
,bs --dialyzer
,bs --credo
,bs --format
For a full list of options, run bs --help
.
Interacting with the Blockscout API
For local devcontainer setups (not applicable to GitHub Codespaces), you can use API testing tools like Postman or Insomnia on your host machine to interact with the Blockscout API running in the container:
- Ensure the Blockscout server is running in the devcontainer.
- In the API testing tool on your host machine, use
http://127.0.0.1:4000
as the base URL. - Example endpoint:
GET http://127.0.0.1:4000/api/v2/blocks
This allows testing API endpoints directly from your host machine while the server runs in the container.
Troubleshooting
If you face issues with dependency compilation or dialyzer after container creation:
- Check for untracked files:
git ls-files --others
- Remove compilation artifacts or generated files if present.
- For persistent issues, consider cleaning all untracked files (use with caution):
git clean -fdX bs --recompile
This ensures a clean compilation environment within the container.
Upgrading Elixir Version
To upgrade the Elixir version:
- Open
.devcontainer/Dockerfile
. - Update the
VARIANT
argument with the desired Elixir version. - Rebuild the devcontainer.
Note: Ensure that the version you choose is compatible with the project dependencies.
After testing the new Elixir version, propagate the corresponding changes in the Dockerfile to the repo https://github.com/blockscout/devcontainer-elixir. Once a new release tag is published there and a new docker image ghcr.io/blockscout/devcontainer-elixir
appears in the GitHub registry, modify the docker-compose.yml
file in the .devcontainer
directory to reflect the proper docker image tag.
Contributing
When contributing changes that require additional checks for specific blockchain types:
- Open
.devcontainer/bin/chain-specific-checks
. - Add your checks under the appropriate
CHAIN_TYPE
case. - Ensure your checks exit with a non-zero code if unsuccessful.
Remember to document any new checks or configuration options in this README.