[Node Operator Question] Node not syncing with docker

[tajelp]

Are you running the most up to date node software?

• Yes

Did you check the documentation?

• Yes

Did you check for duplicate questions?

• Yes

Issue Description

Hello, I am trying to set up a mainnet optimism node with docker. Here's what I did:

git clone https://github.com/smartcontracts/simple-optimism-node.git
cd simple-optimism-node

cp .env.example .env

Then edited .env like this:

###############################################################################
#                                ↓ REQUIRED ↓                                 #
###############################################################################

# Network to run the node on ("op-mainnet" or "op-sepolia")
NETWORK_NAME=op-mainnet

# Type of node to run ("full" or "archive"), note that "archive" is 10x bigger
NODE_TYPE=full

###############################################################################
#                            ↓ REQUIRED (BEDROCK) ↓                           #
###############################################################################

# L1 node that the op-node (Bedrock) will get chain data from
OP_NODE__RPC_ENDPOINT=http://127.0.0.1:8545

# L1 beacon endpoint, you can setup your own or use Quicknode
OP_NODE__L1_BEACON=http://127.0.0.1:5052

# Type of RPC that op-node is connected to, see README
OP_NODE__RPC_TYPE=basic

# Reference L2 node to run healthcheck against
HEALTHCHECK__REFERENCE_RPC_PROVIDER=https://mainnet.optimism.io

###############################################################################
#                            ↓ OPTIONAL (BEDROCK) ↓                           #
###############################################################################

# Optional provider to serve legacy RPC requests, see README
OP_GETH__HISTORICAL_RPC=https://mainnet.optimism.io  

# Set to "full" to force op-geth to use --syncmode=full
OP_GETH__SYNCMODE=full

###############################################################################
#                                ↓ OPTIONAL ↓                                 #
###############################################################################

# Feel free to customize your image tag if you want, uses "latest" by default
# See here for all available images: https://hub.docker.com/u/ethereumoptimism
IMAGE_TAG__L2GETH=
IMAGE_TAG__DTL=
IMAGE_TAG__HEALTCHECK=
IMAGE_TAG__PROMETHEUS=
IMAGE_TAG__GRAFANA=
IMAGE_TAG__INFLUXDB=
IMAGE_TAG__OP_GETH=
IMAGE_TAG__OP_NODE=

# Exposed server ports (must be unique)
# See docker-compose.yml for default values
PORT__L2GETH_HTTP=
PORT__L2GETH_WS=
PORT__DTL=
PORT__HEALTHCHECK_METRICS=
PORT__PROMETHEUS=9111
PORT__GRAFANA=
PORT__INFLUXDB=
PORT__TORRENT_UI=
PORT__TORRENT=
PORT__OP_GETH_HTTP=8585
PORT__OP_GETH_WS=8588
PORT__OP_GETH_P2P=
PORT__OP_NODE_P2P=

Then:

docker compose up -d --build

But it never synces. I noticed there are some error in the logs. I will attach the op-node and op-geth error logs here.

In particular, the errors seems to be:

t=2024-03-12T12:37:43+0000 lvl=warn msg="failed to dial address, but may connect later" addr=http://127.0.0.1:8545

But I am sure the L1 node is reachable on that port:

$ curl -X POST -H "Content-Type: application/json" --data '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":1}' http://127.0.0.1:8545
{"jsonrpc":"2.0","id":1,"result":"0x1288b2d"}

Protocol Description

v1.101308.2
v1.7.0
mainnet/op
10
1

Node Logs

op_node.log
op_geth.log

Additional Information

No response

Feedback

No response

[hash1go]

One possibility is that Docker might be inhibiting communication to the localhost. Please check to ensure there are no issues with your Docker settings.

[tajelp]

$ docker exec -it 30f53d4f8c46 sh
/ $ wget --post-data='{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":1}' http://127.0.0.1:85
45 -O -
Connecting to 127.0.0.1:8545 (127.0.0.1:8545)
wget: can't connect to remote host (127.0.0.1): Connection refused

My eth node is running on my host system. I need to let the docker image reach it from inside the container. Do you know how I can do it?

[hash1go]

I think articles like this would be helpful.
However, to be honest, I haven’t operated a node with a configuration like yours, so I cannot provide a definitive solution.

[imtipi]

Waiting for Bedrock node to initialize...

check bedrock-init container logs
I also recommend you using snap sync,that can bypass the initialize step,and sync faster
https://docs.optimism.io/builders/node-operators/management/snap-sync

[tajelp]

Here I am, trying again with this conf:

.env:

###############################################################################
#                                ↓ REQUIRED ↓                                 #
###############################################################################

# Network to run the node on ("op-mainnet" or "op-sepolia")
NETWORK_NAME=op-mainnet

# Type of node to run ("full" or "archive"), note that "archive" is 10x bigger
NODE_TYPE=full

###############################################################################
#                            ↓ REQUIRED (BEDROCK) ↓                           #
###############################################################################

# L1 node that the op-node (Bedrock) will get chain data from
OP_NODE__RPC_ENDPOINT=http://127.0.0.1:8545

# L1 beacon endpoint, you can setup your own or use Quicknode
OP_NODE__L1_BEACON=http://127.0.0.1:5052

# Type of RPC that op-node is connected to, see README
OP_NODE__RPC_TYPE=basic

# Reference L2 node to run healthcheck against
HEALTHCHECK__REFERENCE_RPC_PROVIDER=https://mainnet.optimism.io

###############################################################################
#                            ↓ OPTIONAL (BEDROCK) ↓                           #
###############################################################################

# Optional provider to serve legacy RPC requests, see README
OP_GETH__HISTORICAL_RPC=

# Set to "full" to force op-geth to use --syncmode=full
OP_GETH__SYNCMODE=full

###############################################################################
#                                ↓ OPTIONAL ↓                                 #
###############################################################################

# Feel free to customize your image tag if you want, uses "latest" by default
# See here for all available images: https://hub.docker.com/u/ethereumoptimism
IMAGE_TAG__L2GETH=
IMAGE_TAG__DTL=
IMAGE_TAG__HEALTCHECK=
IMAGE_TAG__PROMETHEUS=
IMAGE_TAG__GRAFANA=
IMAGE_TAG__INFLUXDB=
IMAGE_TAG__OP_GETH=
IMAGE_TAG__OP_NODE=

# Exposed server ports (must be unique)
# See docker-compose.yml for default values
PORT__L2GETH_HTTP=8585
PORT__L2GETH_WS=8588
PORT__DTL=8606
PORT__HEALTHCHECK_METRICS=8607
PORT__PROMETHEUS=8601
PORT__GRAFANA=8602
PORT__INFLUXDB=8603
PORT__TORRENT_UI=8604
PORT__TORRENT=8605
PORT__OP_GETH_HTTP=8595
PORT__OP_GETH_WS=8598
PORT__OP_GETH_P2P=8599
PORT__OP_NODE_P2P=8600

$ docker ps -a

CONTAINER ID   IMAGE                                                                 COMMAND                  CREATED          STATUS                      PORTS                                                                                                                                                                                              NAMES
5f0dd472b216   ethereumoptimism/replica-healthcheck:latest                           "pnpm run start"         27 minutes ago   Up 27 minutes               0.0.0.0:8607->7300/tcp, :::8607->7300/tcp                                                                                                                                                          simple-optimism-node-healthcheck-1
ef8c2febe0e6   ethereumoptimism/l2geth:latest                                        "/bin/sh -c '/script…"   27 minutes ago   Exited (0) 27 minutes ago                                                                                                                                                                                                      simple-optimism-node-l2geth-1
6347b66e04e2   us-docker.pkg.dev/oplabs-tools-artifacts/images/op-node:v1.7.2        "/scripts/start-op-n…"   27 minutes ago   Up 47 seconds               0.0.0.0:8600->9003/tcp, 0.0.0.0:8600->9003/udp, :::8600->9003/tcp, :::8600->9003/udp                                                                                                               simple-optimism-node-op-node-1
7dfda519b69e   influxdb:1.8                                                          "/entrypoint.sh infl…"   27 minutes ago   Up 27 minutes               0.0.0.0:8603->8086/tcp, :::8603->8086/tcp                                                                                                                                                          simple-optimism-node-influxdb-1
462662523fe4   grafana/grafana:9.3.0                                                 "/run.sh"                27 minutes ago   Up 27 minutes               0.0.0.0:8602->3000/tcp, :::8602->3000/tcp                                                                                                                                                          simple-optimism-node-grafana-1
220e71b45746   us-docker.pkg.dev/oplabs-tools-artifacts/images/op-geth:v1.101308.2   "/scripts/start-op-g…"   27 minutes ago   Up 27 minutes               0.0.0.0:8599->8599/tcp, 0.0.0.0:8599->8599/udp, :::8599->8599/tcp, :::8599->8599/udp, 30303/tcp, 30303/udp, 0.0.0.0:8595->8545/tcp, :::8595->8545/tcp, 0.0.0.0:8598->8546/tcp, :::8598->8546/tcp   simple-optimism-node-op-geth-1
16f016006104   prom/prometheus:latest                                                "/bin/prometheus --c…"   27 minutes ago   Up 27 minutes               9090/tcp, 0.0.0.0:8601->9091/tcp, :::8601->9091/tcp                                                                                                                                                simple-optimism-node-prometheus-1
ed20fe2a2bfa   simple-optimism-node-bedrock-init                                     "/scripts/init-bedro…"   27 minutes ago   Exited (0) 27 minutes ago                                                                                                                                                                                                      simple-optimism-node-bedrock-init-1

op-geth is stuck like this for a while:

INFO [03-26|11:11:14.071] Looking for peers                        peercount=3 tried=95  static=0
INFO [03-26|11:11:24.564] Looking for peers                        peercount=3 tried=90  static=0
INFO [03-26|11:11:34.623] Looking for peers                        peercount=3 tried=28  static=0
INFO [03-26|11:11:44.738] Looking for peers                        peercount=3 tried=81  static=0
INFO [03-26|11:11:54.749] Looking for peers                        peercount=3 tried=16  static=0
INFO [03-26|11:12:05.169] Looking for peers                        peercount=3 tried=82  static=0
INFO [03-26|11:12:15.170] Looking for peers                        peercount=3 tried=39  static=0
INFO [03-26|11:12:25.423] Looking for peers                        peercount=3 tried=80  static=0
INFO [03-26|11:12:35.448] Looking for peers                        peercount=3 tried=37  static=0
INFO [03-26|11:12:45.471] Looking for peers                        peercount=3 tried=53  static=0
INFO [03-26|11:12:55.490] Looking for peers                        peercount=3 tried=70  static=0
INFO [03-26|11:13:05.999] Looking for peers                        peercount=3 tried=32  static=0
INFO [03-26|11:13:15.999] Looking for peers                        peercount=3 tried=70  static=0
INFO [03-26|11:13:26.006] Looking for peers                        peercount=3 tried=51  static=0
INFO [03-26|11:13:36.226] Looking for peers                        peercount=4 tried=93  static=0
INFO [03-26|11:13:46.234] Looking for peers                        peercount=4 tried=72  static=0
INFO [03-26|11:13:56.602] Looking for peers                        peercount=4 tried=68  static=0
INFO [03-26|11:14:06.738] Looking for peers                        peercount=4 tried=82  static=0
INFO [03-26|11:14:16.790] Looking for peers                        peercount=4 tried=30  static=0
INFO [03-26|11:14:26.838] Looking for peers                        peercount=4 tried=41  static=0
INFO [03-26|11:14:36.903] Looking for peers                        peercount=4 tried=87  static=0
INFO [03-26|11:14:47.147] Looking for peers                        peercount=4 tried=84  static=0
INFO [03-26|11:14:57.412] Looking for peers                        peercount=4 tried=55  static=0

and the l2 rpc shows block 0x0:

$ curl -X POST -H "Content-Type: application/json"  --data '{"jsonrpc":"2.0","method":"eth_blockNumber","params":[],"id":1}'   http://localhost:8595
{"jsonrpc":"2.0","id":1,"result":"0x0"}

Logs for each container attached below.
ethereumoptimism/l2geth:latest
simple-optimism-node-bedrock-init
influxdb:1.8
grafana/grafana:9.3.0
us-docker.pkg.dev/oplabs-tools-artifacts/images/op-node:v1.7.2
us-docker.pkg.dev/oplabs-tools-artifacts/images/op-geth:v1.101308.2
ethereumoptimism/replica-healthcheck:latest
prom/prometheus:latest

[imtipi]

# Set to "full" to force op-geth to use --syncmode=full
OP_GETH__SYNCMODE=full

leave it blank to use snap sync

and why your opgeth saids Waiting for Bedrock node to initialize... while opnode already running...

[tajelp]

leave it blank to use snap sync

invalid value "" for flag -syncmode: unknown sync mode "", want "full", "snap" or "light"

I set it to snap. I will let you know. Thanks

[tajelp]

Here's the situation now:

$ docker ps -a
CONTAINER ID   IMAGE                                                                 COMMAND                  CREATED             STATUS                         PORTS                                                                                                                                                                                              NAMES
fe1d1f476c3a   ethereumoptimism/replica-healthcheck:latest                           "pnpm run start"         About an hour ago   Up About an hour               0.0.0.0:8607->7300/tcp, :::8607->7300/tcp                                                                                                                                                          simple-optimism-node-healthcheck-1
566ffe546842   influxdb:1.8                                                          "/entrypoint.sh infl…"   About an hour ago   Up About an hour               0.0.0.0:8603->8086/tcp, :::8603->8086/tcp                                                                                                                                                          simple-optimism-node-influxdb-1
5cff2a01a29c   ethereumoptimism/l2geth:latest                                        "/bin/sh -c '/script…"   About an hour ago   Exited (0) About an hour ago                                                                                                                                                                                                      simple-optimism-node-l2geth-1
5b368cd2cdc8   prom/prometheus:latest                                                "/bin/prometheus --c…"   About an hour ago   Up About an hour               9090/tcp, 0.0.0.0:8601->9091/tcp, :::8601->9091/tcp                                                                                                                                                simple-optimism-node-prometheus-1
4dbf6d9b3bb0   simple-optimism-node-bedrock-init                                     "/scripts/init-bedro…"   About an hour ago   Exited (0) About an hour ago                                                                                                                                                                                                      simple-optimism-node-bedrock-init-1
047a9b87f6f3   us-docker.pkg.dev/oplabs-tools-artifacts/images/op-node:v1.7.2        "/scripts/start-op-n…"   About an hour ago   Up 33 seconds                  0.0.0.0:8600->9003/tcp, 0.0.0.0:8600->9003/udp, :::8600->9003/tcp, :::8600->9003/udp                                                                                                               simple-optimism-node-op-node-1
f7333038a785   us-docker.pkg.dev/oplabs-tools-artifacts/images/op-geth:v1.101308.2   "/scripts/start-op-g…"   About an hour ago   Up About an hour               0.0.0.0:8599->8599/tcp, 0.0.0.0:8599->8599/udp, :::8599->8599/tcp, :::8599->8599/udp, 30303/tcp, 30303/udp, 0.0.0.0:8595->8545/tcp, :::8595->8545/tcp, 0.0.0.0:8598->8546/tcp, :::8598->8546/tcp   simple-optimism-node-op-geth-1
ca5f5317d695   grafana/grafana:9.3.0                                                 "/run.sh"                About an hour ago   Up About an hour               0.0.0.0:8602->3000/tcp, :::8602->3000/tcp                                                                                                                                                          simple-optimism-node-grafana-1

ethereumoptimism/replica-healthcheck:latest
us-docker.pkg.dev/oplabs-tools-artifacts/images/op-geth:v1.101308.2
grafana/grafana:9.3.0
influxdb:1.8
ethereumoptimism/l2geth:latest
prom/prometheus:latest
simple-optimism-node-bedrock-init
us-docker.pkg.dev/oplabs-tools-artifacts/images/op-node:v1.7.2

[tajelp]

Solved by setting up an http proxy listening on 0.0.0.0 which redirects the traffic between docker gateway and the host machine's geth host and port (127.0.0.1:8545).

[Chomtana]

You need to use host.docker.internal instead of 127.0.0.1 because 127.0.0.1 means localhost in the container (Not the host)

Sorry for the late response. This should be documented