java.lang.NullPointerException

[zhanghuize-git]

Context & versions

when I use docker image cardanofoundation/cardano-rosetta-java:latest, I find some error in docker logs. I use docker run container commod, is it exhausting my server's resources because the image is at risk of memory leaks?

My service config

cpu

Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Address sizes: 46 bits physical, 48 bits virtual
Byte Order: Little Endian
CPU(s): 8
On-line CPU(s) list: 0-7
Vendor ID: GenuineIntel
Model name: Intel(R) Xeon(R) Platinum 8488C
CPU family: 6
Model: 143
Thread(s) per core: 2
Core(s) per socket: 4
Socket(s): 1
Stepping: 8
BogoMIPS: 4800.00

memory

           total        used        free      shared  buff/cache   available

Mem: 30Gi 20Gi 532Mi 143Mi 10Gi 10Gi
Swap: 0B 0B 0B

[Kammerlo]

Is this reproducible? Which request are you using and on which network are you seeing this errors?

I will try to test it on my end to double check and to find the issue.

[zhanghuize-git]

When I use mainnet, I find this errors.

[Kammerlo]

Could you share the request you are trying? Then I will try to reproduce it on my end

[matiwinnetou]

I reported it here: bloxbean/yaci-store#434

[matiwinnetou]

@zhanghuize-git please see explanation to this small bug in bloxbean/yaci-store#434, if this happens while replaying the chain it's not critical at all, it will stop when rosetta reaches the tip.

[zhanghuize-git]

cardano-node-1 | [2288936c:cardano.node.InboundGovernor:Info:139] [2025-02-08 08:54:20.76 UTC] TrMaturedConnections (fromList [95.216.222.3:3000,3.135.125.51:3001,152.53.121.235:3001,125.229.192.148:6000]) (fromList [])
yaci-indexer-1 | 2025-02-08T08:54:22.302Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 2757 ms
yaci-indexer-1 | 2025-02-08T08:54:22.302Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5388956 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:54:22.421Z DEBUG 1 --- [ntLoopGroup-5-1] c.b.c.y.c.p.keepalive.KeepAliveAgent : MsgKeepAliveResponse: MsgKeepAliveResponse(cookie=14844)
yaci-indexer-1 | 2025-02-08T08:54:26.894Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 4592 ms
yaci-indexer-1 | 2025-02-08T08:54:26.894Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5389156 , Era: Allegra
api-1 | 2025-02-08T08:54:28.569Z INFO 1 --- [nio-8082-exec-9] o.c.r.a.n.service.NetworkServiceImpl : [networkOptions] Looking for networkOptions
yaci-indexer-1 | 2025-02-08T08:54:29.415Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 2521 ms
yaci-indexer-1 | 2025-02-08T08:54:29.415Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5389356 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:54:31.166Z DEBUG 1 --- [ ] c.b.c.y.c.p.k.s.KeepAliveSerializers : MsgKeepAlive (serialized) : 8200199b60
yaci-indexer-1 | 2025-02-08T08:54:32.531Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 3116 ms
yaci-indexer-1 | 2025-02-08T08:54:32.531Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5389556 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:54:36.883Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 4352 ms
yaci-indexer-1 | 2025-02-08T08:54:36.883Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5389756 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:54:41.779Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 4896 ms
yaci-indexer-1 | 2025-02-08T08:54:41.780Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5389956 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:54:41.868Z DEBUG 1 --- [ntLoopGroup-5-1] c.b.c.y.c.p.keepalive.KeepAliveAgent : MsgKeepAliveResponse: MsgKeepAliveResponse(cookie=39776)
yaci-indexer-1 | 2025-02-08T08:54:44.985Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 3205 ms
yaci-indexer-1 | 2025-02-08T08:54:44.985Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5390156 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:54:47.743Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 2758 ms
yaci-indexer-1 | 2025-02-08T08:54:47.743Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5390356 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:54:51.001Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 3257 ms
yaci-indexer-1 | 2025-02-08T08:54:51.001Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5390556 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:54:51.166Z DEBUG 1 --- [ ] c.b.c.y.c.p.k.s.KeepAliveSerializers : MsgKeepAlive (serialized) : 8200199e3d
yaci-indexer-1 | 2025-02-08T08:54:53.943Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 2942 ms
yaci-indexer-1 | 2025-02-08T08:54:53.943Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5390756 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:54:57.119Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 3175 ms
yaci-indexer-1 | 2025-02-08T08:54:57.119Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5390956 , Era: Allegra
api-1 | 2025-02-08T08:54:58.620Z INFO 1 --- [nio-8082-exec-1] o.c.r.a.n.service.NetworkServiceImpl : [networkOptions] Looking for networkOptions
yaci-indexer-1 | 2025-02-08T08:54:59.810Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 2691 ms
yaci-indexer-1 | 2025-02-08T08:54:59.810Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5391156 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:55:02.404Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 2594 ms
yaci-indexer-1 | 2025-02-08T08:55:02.404Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5391356 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:55:05.504Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 3099 ms
yaci-indexer-1 | 2025-02-08T08:55:05.504Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5391556 , Era: Allegra
cardano-node-1 | [2288936c:cardano.node.ChainDB:Notice:113] [2025-02-08 08:55:08.16 UTC] Chain extended, new tip: 189d01dec939be9ea695e8a0c28105b130f52d82d08b28b15caf630558ab7962 at slot 147438617
yaci-indexer-1 | 2025-02-08T08:55:08.976Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : # of blocks written: 200, Time taken: 3472 ms
yaci-indexer-1 | 2025-02-08T08:55:08.976Z INFO 1 --- [ntLoopGroup-5-1] c.b.c.y.s.c.service.CursorServiceImpl : Block No: 5391756 , Era: Allegra
yaci-indexer-1 | 2025-02-08T08:55:09.013Z DEBUG 1 --- [ntLoopGroup-5-1] c.b.c.y.c.p.keepalive.KeepAliveAgent : MsgKeepAliveResponse: MsgKeepAliveResponse(cookie=40509)

Hello, Kammerlo.
When I downloaded the snapshot, started the cardano-node and synchronized to the latest slot, I started yaci-indexer again. At first it was very fast, but after synchronizing to 5401956, the speed became slower, and the synchronization speed was ten different. Why? Is this normal?

[Kammerlo]

Hey @zhanghuize-git,
the decreasing speed is known. We reported it in this issue: #271
It is because we need to drop indexes while syncing and reapply them, when the indexer reaches the tip. It will be implemented soon.
If you want a quick fix you can do the dropping and reapply the indexes manually. Here are examples from yaci-store:

• https://github.com/bloxbean/yaci-store/blob/main/applications/all/src/main/resources/sql/drop-index.sql
• https://github.com/bloxbean/yaci-store/blob/main/applications/all/src/main/resources/sql/create-index.sql

In rosetta-java we don't use all indexes in these scripts so some adjustments are needed, but I can send you an example script which works with the rosetta-java db on monday.

[zhanghuize-git]

If I don't do anything else, how long will it take to synchronize?

[Kammerlo]

I would say 3-4 days. maximum.

[zhanghuize-git]

I'm a little confused about what to do. My goal now is to quickly build a cardano node for json rpc services to use, but now yaci-indexer has taken too much time. Can you tell me what to do? Thanks

[zhanghuize-git]

Where should I run the SQL script you provide?

[Kammerlo]

So you have two options now:

1. Start Rosetta-java normally without changing anything - this will take as I mentioned 3-4 days syncing maximum, but doesn't involve any manual changes from your side
2. Drop Indexes and recreate them, when the indexer reaches the tip - This will be faster round about 1 day, but you need to run the following SQL queries in your database,

• after the indexer started syncing: Drop Indexes
• After the indexer reached the typ: Create Indexes

The second step will be done automatically in the future, but for now this needs to be done manually, if the syncing speed is to slow. If you are okay with waiting a little bit longer I would recommend not changing anything manual in the database and go with option 1.

[zhanghuize-git]

I get it， thank you Kammerlo