Lightning batch transactions confirmations, spv (wip), refactors #1045 (#1339)

* remove ok_or_retry_after_sleep_sync! macro

* process_txs_confirmations independent from update_best_block

* use get_tx_height in get_confirmed_registered_txs to prepare for batch requests

* validate_spv_proof refactor wip, spv for lightning wip

* fix test_spv_proof

* remove find_watched_output_spend_with_header

* impl some features of rust-lightning v0.0.106 wip, import code from lightning-persister v0.0.106 and lightning-background-processor v0.0.106 wip

* add inbound channels details to sql db

* remove lightning-persister and lightning-background-processor crates from our codebase and use v0.0.106 crates instead

* remove ok_or_continue macro, use join_all to check for transactions confirmations in batches

* small fixes after testing

* fix fmt

* get confirmed transaction info from spv proof fn

* move get_tx_if_onchain, get_tx_height to rpc_clients

* spv proof refactoring wip

* fix fmt

* spv proof refactor

* break ln_storage.rs to multiple files, break up persister struct into db struct and filesystem struct

* fixes for persisting monitors to back up dir

* fix clippy for windows

* fix some todos

* btc difficulty calculations for spv validation wip

* continued: btc difficulty calculations for spv validation wip, added more test cases

* continued: btc difficulty calculations for spv validation wip, work.rs, storage.rs

* fix wasm, tests

* spv difficulty testnet

* fix some todos

* fixes after merge

* add events abort handlers

* Review fixes wip

* Review fixes wip, log db error in open_channel, workTestVectors.json

* Review fixes, save claiming tx to db after successful broadcasting

* Review fixes wip, use bool without casting, use i64 instead of u64 casting for db operations

* Review fixes wip, #[cfg(target_family = "windows")], refactors

* Review fixes, get tx height by block hash

Author: shamardy

Cargo.lock

@@ -1,8 +1,6 @@
 [workspace]
 members = [
     "mm2src/coins",
-    "mm2src/coins/lightning_persister",
-    "mm2src/coins/lightning_background_processor",
     "mm2src/coins/utxo_signer",
     "mm2src/coins_activation",
     "mm2src/common/shared_ref_counter",

Cargo.toml

@@ -50,7 +50,6 @@ keys = { path = "../mm2_bitcoin/keys" }
 lazy_static = "1.4"
 libc = "0.2"
 lightning = { git = "https://github.com/shamardy/rust-lightning", branch = "0.0.106" }
-lightning-background-processor = { path = "lightning_background_processor" }
 lightning-invoice = { git = "https://github.com/shamardy/rust-lightning", branch = "0.0.106" }
 metrics = "0.12"
 mm2_core = { path = "../mm2_core" }
@@ -99,7 +98,8 @@ web-sys = { version = "0.3.55", features = ["console", "Headers", "Request", "Re
 
 [target.'cfg(not(target_arch = "wasm32"))'.dependencies]
 dirs = { version = "1" }
-lightning-persister = { path = "lightning_persister" }
+lightning-background-processor = { git = "https://github.com/shamardy/rust-lightning", branch = "0.0.106" }
+lightning-persister = { git = "https://github.com/shamardy/rust-lightning", branch = "0.0.106" }
 lightning-net-tokio = { git = "https://github.com/shamardy/rust-lightning", branch = "0.0.106" }
 rust-ini = { version = "0.13" }
 rustls = { version = "0.20", features = ["dangerous_configuration"] }