Casey Gardiner
7ab8be3377
Release Candidate: dev -> main ( #4319 )
...
* Rebase dev branch to current main branch (#4318 )
* add openssl compatibility on m2 chips using darwin (#4302 )
Adds support for OpenSSL on MacOS Ventura using m2 chips.
* [dumpdb] ensure each cross link is dumped (#4311 )
* bump libp2p to version 0.24.0 and update its dependencies and relevant tests (#4315 )
* Removed legacy syncing peer provider. (#4260 )
* Removed legacy syncing peer provider.
* Fix localnet.
* Fix migrate version.
* Rebased on main.
* Fix formatting.
* Remove blockchain dependency from engine. (#4310 )
* Consensus doesn't require anymore `Node` as a circular dependency.
* Rebased upon main.
* Removed engine beacon chain dependency.
* Fixed nil error.
* Fixed error.
* bump libp2p to version 0.24.0 and update its dependencies and relevant tests
* fix format, remove wrongly added configs
* add back wrongly deleted comment
* fix travis go checker
Co-authored-by: Konstantin <355847+Frozen@users.noreply.github.com>
Co-authored-by: “GheisMohammadi” <“Gheis.Mohammadi@gmail.com”>
* bump libp2p to version 0.24.0 and update its dependencies and relevant tests (#4315 )
* Removed legacy syncing peer provider. (#4260 )
* Removed legacy syncing peer provider.
* Fix localnet.
* Fix migrate version.
* Rebased on main.
* Fix formatting.
* Remove blockchain dependency from engine. (#4310 )
* Consensus doesn't require anymore `Node` as a circular dependency.
* Rebased upon main.
* Removed engine beacon chain dependency.
* Fixed nil error.
* Fixed error.
* bump libp2p to version 0.24.0 and update its dependencies and relevant tests
* fix format, remove wrongly added configs
* add back wrongly deleted comment
* fix travis go checker
Co-authored-by: Konstantin <355847+Frozen@users.noreply.github.com>
Co-authored-by: “GheisMohammadi” <“Gheis.Mohammadi@gmail.com”>
* Fix for consensus stuck. (#4307 )
* Added check for block validity.
* Starts new view change if block invalid.
* Revert "Starts new view change if block invalid."
This reverts commit e889fa5da2e0780f087ab7dae5106b96287706db.
* staged dns sync v1.0 (#4316 )
* staged dns sync v1.0
* enabled stream downloader for localnet
* fix code review issues
* remove extra lock
Co-authored-by: “GheisMohammadi” <“Gheis.Mohammadi@gmail.com”>
* add description for closing client and change randomize process to ma… (#4276 )
* add description for closing client and change randomize process to make sure only online nodes are added to sync config
* fix sync test
* fix legacy limitNumPeers test
* add WaitForEachPeerToConnect to node configs to make parallel peer connection optional
Co-authored-by: “GheisMohammadi” <“Gheis.Mohammadi@gmail.com”>
* Small fixes and code cleanup for network stack. (#4320 )
* staged dns sync v1.0
* enabled stream downloader for localnet
* fix code review issues
* remove extra lock
* staged dns sync v1.0
* Fixed, code clean up and other.
* Fixed, code clean up and other.
* Fixed, code clean up and other.
* Fix config.
Co-authored-by: “GheisMohammadi” <“Gheis.Mohammadi@gmail.com”>
* Fix not disable cache in archival mode (#4322 )
* Feature registry (#4324 )
* Registry for services.
* Test.
* Reverted comment.
* Fix.
* Slash fix (#4284 )
* Implementation of new slashing rate calculation
* Write tests for then new slashing rate calculation
* Add engine.applySlashing tests
* fix #4059
Co-authored-by: Alex Brezas <abresas@gmail.com>
Co-authored-by: Dimitris Lamprinos <pkakelas@gmail.com>
* Bump github.com/aws/aws-sdk-go from 1.30.1 to 1.33.0 (#4325 ) (#4328 )
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go ) from 1.30.1 to 1.33.0.
- [Release notes](https://github.com/aws/aws-sdk-go/releases )
- [Changelog](https://github.com/aws/aws-sdk-go/blob/v1.33.0/CHANGELOG.md )
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.30.1...v1.33.0 )
---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Bump github.com/btcsuite/btcd from 0.21.0-beta to 0.23.2 (#4327 ) (#4329 )
Bumps [github.com/btcsuite/btcd](https://github.com/btcsuite/btcd ) from 0.21.0-beta to 0.23.2.
- [Release notes](https://github.com/btcsuite/btcd/releases )
- [Changelog](https://github.com/btcsuite/btcd/blob/master/CHANGES )
- [Commits](https://github.com/btcsuite/btcd/compare/v0.21.0-beta...v0.23.2 )
---
updated-dependencies:
- dependency-name: github.com/btcsuite/btcd
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: Max <82761650+MaxMustermann2@users.noreply.github.com>
Co-authored-by: Gheis <36589218+GheisMohammadi@users.noreply.github.com>
Co-authored-by: Konstantin <355847+Frozen@users.noreply.github.com>
Co-authored-by: “GheisMohammadi” <“Gheis.Mohammadi@gmail.com”>
Co-authored-by: Danny Willis <102543677+dannyposi@users.noreply.github.com>
Co-authored-by: PeekPI <894646171@QQ.COM>
Co-authored-by: Alex Brezas <abresas@gmail.com>
Co-authored-by: Dimitris Lamprinos <pkakelas@gmail.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2 years ago
Konstantin
6ade0bfa34
Small fixes and code cleanup for network stack. ( #4320 )
...
* staged dns sync v1.0
* enabled stream downloader for localnet
* fix code review issues
* remove extra lock
* staged dns sync v1.0
* Fixed, code clean up and other.
* Fixed, code clean up and other.
* Fixed, code clean up and other.
* Fix config.
Co-authored-by: “GheisMohammadi” <“Gheis.Mohammadi@gmail.com”>
2 years ago
Gheis
0104b1d623
add description for closing client and change randomize process to ma… ( #4276 )
...
* add description for closing client and change randomize process to make sure only online nodes are added to sync config
* fix sync test
* fix legacy limitNumPeers test
* add WaitForEachPeerToConnect to node configs to make parallel peer connection optional
Co-authored-by: “GheisMohammadi” <“Gheis.Mohammadi@gmail.com”>
2 years ago
Gheis
54742e73e1
staged dns sync v1.0 ( #4316 )
...
* staged dns sync v1.0
* enabled stream downloader for localnet
* fix code review issues
* remove extra lock
Co-authored-by: “GheisMohammadi” <“Gheis.Mohammadi@gmail.com”>
2 years ago
Konstantin
7a61257f24
Min bound, reconnect and additional checks. ( #4257 )
2 years ago
Konstantin
0753c94c2b
Epoch syncing - syncing only epoch blocks. ( #4070 )
...
* Epoch syncing - syncing only epoch blocks.
* Fix go test, added command to run.
* Block signature validation.
* Support getting block by height.
* Fix to compile.
* Http method.
* Generate fix.
* Install protoc-gen-go-grpc.
* Fix sync, additional timeouts, fix epoch.
* Chain behaviour options, optional state validation on blockchain initialization.
* Added limit to avoid abuse, small fixes.
* Fix duplicate code.
* Fix isInSyn.
* Fix method call.
* Removed additional block sending.
* Fix in sync.
* Code clean up.
* Fix beacon chain func.
* Return back Beaconchain.
* Fix sending only epoch blocks.
* Fix failed startup with validator.
* Increase recv message size.
* Remove peer.
* Add logs.
* Add logs.
* Fix msgf call.
* Epoch syncing - syncing only epoch blocks.
* Block signature validation.
* Fix sync, additional timeouts, fix epoch.
* Chain behaviour options, optional state validation on blockchain initialization.
* Support getting block by height.
* Http method.
* Fix duplicate code.
* Fix isInSyn.
* Added limit to avoid abuse, small fixes.
* Fix method call.
* Removed additional block sending.
* Fix in sync.
* Small fix.
* Code clean up.
* Fix beacon chain func.
* Return back Beaconchain.
* Fix sending only epoch blocks.
* Fix failed startup with validator.
* Increase recv message size.
* Remove peer.
* Add logs.
* Fix msgf call.
* Sending crosslinks from beacon to non-beacon chains.
* Receiving crosslinks.
* Broadcast.
* Fix comment.
* Crosslink signal.
* Crosslink hardbeat signal receiving.
* Sending crosslinks from beacon to non-beacon chains.
* Sending crosslinks from beacon to non-beacon chains.
* Broadcast.
* Fix comment.
* Crosslink signal.
* Crosslink signal.
* Add comment to run tests.
* Fix comments.
* Fix comments.
* Fix review comments.
* Updated with last crosslink heart beat signal.
* Merged crosslink signal.
* Clean up code.
* Add logs for cl debug.
* Stop iterate on receiving result.
* Add logs.
* Fix in sync check.
* Fix reconnect problems.
* Fix tests and reduce dependency.
* Updated with main.
* Fix review comments.
* Changed to compare epochs.
* Fix crosslinks usage.
* Fix initialization.
* Epoch chain implementation.
* Legacy sync by default.
* Revert "Legacy sync by default."
This reverts commit 5fa6ce002a
.
* Epoch sync for downloader.
* Build docker image while tests.
* Fix paths.
* Updated travis.
* Review improvements.
Co-authored-by: Konstantin <k.potapov@softpro.com>
2 years ago
Konstantin
4eabc120b1
Blockchain interface. ( #4214 )
...
* Blockchain interface.
* Fix comments, remove unused.
Co-authored-by: Konstantin <k.potapov@softpro.com>
2 years ago
Jacky Wang
2f679554eb
[SYNC] Sync stuck fix2 ( #3976 )
...
* fix an data race cause by early unlock
* add a concurrency test for syncing cache
* skip the concurrent test for sync status
3 years ago
Jacky Wang
f0103161ae
[sync] release one runlock at forEachPeer, and change default maxPeerHeight to maxInt if error
3 years ago
Jacky Wang
a135e1f110
[sync] extend the expiration for sync status cache for non-validator nodes ( #3974 )
3 years ago
Jacky Wang
d7af5ee9e0
[SYNC] refactor and make sync status check interval smaller ( #3918 )
...
* [sync] further refactor the underlying code of sync rpc, make the sync status update every 6 seconds
* [SYNC] recover some unexpected comment change because of refactoring
* [rpc] add some tolerance of 10 to inSync and beaconInSync
* fix typo
* [sync] better name
* fix the data race under intensive sync status call
* [sync] fix the intensive call with double lock. Fix bug of dead lock
* remove one test message
3 years ago
Jacky Wang
3e5c0e035e
[sync] remove two unnecessary use of global mutex in StateSync ( #3970 )
...
* [sync] remove two unnecessary global mutex in StateSync
* [rpc] remove another unnecessary use of global mutex.
3 years ago
Jacky Wang
c1f62404a3
Sync status rpc fix ( #3912 )
...
* [RPC] avoid RPC call DNS service
* [rpc] refactored function name
3 years ago
Rongjian Lan
1ce6fe1355
Add logs for elapsed time for block processing; Add bls agg sig benchmark test code. ( #3824 )
...
* Add timing log and agg sig tests
* fix build
* add more logs
3 years ago
Leo Chen
07807c8f2d
[sync] add a tolerance number for node-sync checking
...
Signed-off-by: Leo Chen <leo@harmony.one>
3 years ago
Jacky Wang
ba08520b28
[sync] changed param to support low network bandwidth against large block ( #3766 )
...
* [sync] changed param to support low network bandwidth against large block
* [sync] increase the retry limit per process loop
4 years ago
Jacky Wang
720aa234d2
[sync] half the batch size of downloading a block ( #3745 )
4 years ago
Leo Chen
5a93de7b83
[log] set noisy log message to debug level
...
Signed-off-by: Leo Chen <leo@harmony.one>
4 years ago
Jacky Wang
66e6d035e3
[sync] make sync rpc compatible with legacy sync
4 years ago
Jacky Wang
e8266f5c86
[sync] ease the verification on dns client side, enable server forward compatibility
4 years ago
Jacky Wang
6275eaf0b0
[sync] fix the bug in UpdateBlockAndStatus
4 years ago
Jacky Wang
2916c3379f
[sync][stream] remove writeCommitSig in both legacy sync and downloader
4 years ago
Jacky Wang
cfb71007b9
[sync] fix error of cross-shard transaction
4 years ago
Jacky Wang
9a27b46bb8
[sync] fixed beacon sync signature verification
4 years ago
Jacky Wang
b91db85c23
[sync] add commit signature in peer registeration and new block push
4 years ago
Jacky Wang
bec43ca07e
[sync] refactor the convoluted logic in processStateSync
4 years ago
Jacky Wang
a4001a92de
[sync] fix two bugs
4 years ago
Jacky Wang
d4ae4fb1a6
[sync] added commit sig verification logic to legacy sync
4 years ago
Jacky Wang
c05e150aa7
[stream] rename dns syncing package to legacysync
4 years ago
Jacky Wang
77ab16dd81
[sync] added more logs to help debug testnet issue.
4 years ago
Jacky Wang
72ae4da105
[sync] fix #3547 runtime panic in sync module
4 years ago
Jacky Wang
a7a248e323
[explorer][sync] make updateConsensusInformation only happens for explorer node
4 years ago
Jacky Wang
089f33d1dc
[sync][explorer] add some comments in sync
4 years ago
Jacky Wang
d9734e77db
[sync] fix sync
4 years ago
Jacky Wang
37bf0e7f73
[sync] fix explorer sync
4 years ago
Jacky Wang
3abec6b768
[consensus] move prune block logic to SetupForNewConsensus
4 years ago
Rongjian Lan
e8e8e77a8a
remove unsync update
4 years ago
Rongjian Lan
56d4bc2b1b
fix comment
4 years ago
Rongjian Lan
0029ced6b2
Add constant for timeouts
4 years ago
Rongjian Lan
8db8802eed
send committed at 67%
4 years ago
Rongjian Lan
0e95cb634b
fix sync race condition
4 years ago
Rongjian Lan
04e918eedd
fix sync threshold, have to be 0
4 years ago
Jacky Wang
4da04b89eb
[sync] add duplicity check logic in syncing peers
4 years ago
Jacky Wang
5fcee1fd71
[sync] add break when removing peers
4 years ago
Jacky Wang
aad516fa39
[sync] reduce error level when get block return error
4 years ago
Jacky Wang
c16c4bd9db
[sync] add removing peer logic when grpc return an error
4 years ago
Rongjian Lan
6a72ca14ad
make block sync trigger less frequent
4 years ago
Jacky Wang
7801a1d678
[consensus][sync] Better coordination between state sync and consensus module. ( #3352 )
...
* [rawdb] add error handling to all rawdb write. Add fdlimit module. Fix the node stuck
* [core] switch back the batch write condition in InsertReceiptChain
* [rawdb] add error handling to all rawdb write. Add fdlimit module. Fix the node stuck
* [consensus] refactored and optimized tryCatchup logic
* [sync] added consensus last mile block in sync.
* [consensus] remove time wait for consensus inform sync. Make block low chan a buffered chan
* [consensus] fix rebase errors, and optimize one line code
* [consensus][sync] fix golint error and added prune logic in sync
* [consensus] move header verify after adding FBFT log in onPrepared
* [consensus] more change on block verification logic
* [consensus] fix the verified panic issue
* [consensus][sync] add block verification in consensus last mile, change it to iterator
* [consensus] fix two nil pointer references when running local node (Still cannot find the root cause for it)
* remove coverage.txt and add to gitignore
* [consensus] add leader key check. Move quorum check logic after tryCatchup and can spin state sync
* [consensus] remove the leader sender check for now. Will add later
* [consensus] refactor fbftlog to get rid of unsafe mapset module. Replace with map
* [consensus] move the isQuorumAchived logic back. We surely need to check it before add to FBFTlog
* [consensus] remove the redundant block nil check
* [test] fix the consensus test
* [consensus] rebase main and fix stuff. Removed isSendByLeader
* [consensus] added logic to spin up sync when received message is greater than consensus block number
* [consensus] more changes in consensus. Remove some spin sync logic.
* fix error in main
* [consensus] change the hash algorithm of the FBFTLog to get rid of rlp error
* [consensus] use seperate mutex in FBFT message
* [consensus] change fbft log id to a shorter form. Added unit test case
4 years ago
Jacky Wang
2430a85162
[core] node stuck fix ( #3378 )
...
* [rawdb] add error handling to all rawdb write. Add fdlimit module. Fix the node stuck
* [core] switch back the batch write condition in InsertReceiptChain
* [core] add comments on isUnrecoverableErr
4 years ago
Jacky Wang
3adab4496c
Revert "[consensus] enable the consensus module can spin up doSync ( #3340 )" ( #3350 )
...
This reverts commit f9c26e663b
.
4 years ago