86 Commits (191e8a66c5c4c9ac4470a7573cc2241af10907ec)

Author	SHA1	Message	Date
Paul Tsupikoff	6a5916764d	Consolidate POSDAO contract reading (#2371) ... Previously, staking contract reading was arbitrarily spread across Explorer.Staking.ContractState, Explorer.Staking.PoolsReader and Indexer.Fetcher.StakingPools. Using async fetcher infrastructure for staking contracts is inadequate, as blocks may arrive out of order, while we want fetching to be triggered by newer block arrival. Also, contract calls were not batched enough, and it was hard to follow their sequence across involved modules. Now, on each incoming block, which is newer than the last seen, we fully update not only global contract state, but all validators, pools and delegators. All requests are intelligently compiled into four batches. These are defined together to give better overview of performed actions. Chain.import infrastructure is still used for inserting data into DB to leverage smart batching of INSERT queries. Likelihood calculation is added: it zips results of getPoolsToBeElected and getPoolsLikelihood calls to make a map of addresses. Only POS_STAKING_CONTRACT env variable is required now. Other contract addresses are fetched from it during launch. ABIs are concatenated together during launch as well, as we don't support batch requests against distinct ABIs yet. This should be addressed in further PRs. Up-to-date ABIs copied from build artifacts of posdao-contracts repo. File names now correspond to contract names, README directs to their origin. * Fetch inactive delegators, mark pools and delegators deleted (#2205) * Fetch min stakes and token contract address from StakingAuRa (#2313) * Fetch block reward ratio using validatorRewardPercent getter (#2424) * Add missing `banned_until` field in ON CONFLICT clause for staking pools.	4 years ago
Victor Baranov	d9304c03f8	Handle errors for non-archive node	4 years ago
Victor Baranov	6e4fceb229	Switch to RPC endpoint polling if ETHEREUM_JSONRPC_WS_URL is an empty string	4 years ago
Victor Baranov	e9f1b6281a	Finalize bridged tokens	4 years ago
Victor Baranov	089b74aafe	Bridged tokens	4 years ago
Victor Baranov	067b67547a	Fix several tests	5 years ago
Victor Baranov	32d3bb85ed	Disable Pending transactions supervisor	5 years ago
Victor Baranov	41dc4bdb4d	Finalize Besu variant	5 years ago
Victor Baranov	e59af5dc57	extend optionalilty of websockets to Geth	5 years ago
Victor Baranov	444ea6ac0e	Remove default websockets URL from config	5 years ago
Victor Baranov	00618872cf	Rename ETHEREUM_JSONRPC_JSON_RPC_TRANSPORT env var	5 years ago
Victor Baranov	d227729db6	Get rid of all first traces	5 years ago
Victor Baranov	f8cf0d194b	Revert realtime fetcher small skips feature	5 years ago
Ayrat Badykov	2b4fa54a8e	allow to select IPC transport	5 years ago
Ayrat Badykov	141ebda719	fix message handling	5 years ago
pasqu4le	e8c2fa554e	Allow Realtime Fetcher to wait for small skips ... Problem: Sometimes the realtime fetcher's `newHeads` websocket subscription skips a small amount of block numbers, just to be followed by those very same numbers that were skipped, without repeating the number that caused the skipping. This may be cause by out-of-order events or be a legitimate reorg, but in any case this causes close-in-time refetching which in turn leads to async insertions problems. Solution: allow the Realtime fetcher to keep track of a small (settable) skip and wait for the block number inside the skip to arrive before fetching the whole window. Obviously if it gets notified of the blocks following the skip (or it is forced into polling) the whole window gets fetched and inserted.	5 years ago
saneery	12ebc6fad8	Add LAST_BLOCK var to reindex range of blocks	5 years ago
saneery	1e4de6e41e	Add env to disable indexer supervisor	5 years ago
Victor Baranov	f7fc61c868	Revoke changes for Geth	5 years ago
Victor Baranov	0bb7685cae	Optional websockets for dev environment	5 years ago
Ayrat Badykov	6e2572b8cc	mix format	6 years ago
Ayrat Badykov	857ac30058	use seconds	6 years ago
Ayrat Badykov	913147185c	allow to configure token metadata update interval	6 years ago
Victor Baranov	6a6a10ecb2	Increase timeout for geth indexers	6 years ago
saneery	e9c61945e6	add staking pools fetcher	6 years ago
Paul Tsupikoff	b8a8a008ec	Make websocket optional for realtime fetcher (#1778) ... Realtime fetcher already uses both websocket and JSONRPC polling for more reliable new block fetching. Though, if no websocket was available, the realtime fetcher wouldn't start, and no new blocks arrived at all. As we already have a polling fallback, we now make websocket optional. This will also help with supporting nodes without websocket API. To disable websocket API, pass `nil` in `subscribe_named_arguments.transport`.	6 years ago
Ayrat Badykov	cb920e29f4	fix first block parameter	6 years ago
zachdaniel	8c1bb01fb1	feat: Add RSK support	6 years ago
Paul Tsupikoff	c423a41e49	Flatten indexer module hierarchy and supervisor tree (#1718) ... * Add a defsupervisor macro with common supervisor functionality This macro allows removing more than a dozen of copy-pasted `supervisor.ex` modules. The `Indexer.Fetcher` module will be expanded with even more common fetcher functionality in upcoming PRs. * Flatten indexer module hierarchy and remove generated supervisors Modules are organized into 3 directories: `fetcher`, `transform` and `temporary`. Supervisors are replaced with `use Indexer.Fetcher` clause. `token_balances.ex` and block fetchers are left as-is for now, as they require more invasive code refactoring, which will be done in upcoming PRs. * Flatten supervisor tree There is no need in separate `Block.Supervisor` hierarchy, so its children are placed in the root supervisor tree. The tree itself is moved to `Indexer.Supervisor` module to reduce amount of directories. * Add CHANGELOG.md entry	6 years ago
Ayrat Badykov	11a288120f	decrease token metadata update interval	6 years ago
Ayrat Badykov	946b596abc	allow to set first indexing block	6 years ago
Ayrat Badykov	2d51a7f76c	add logging	6 years ago
nervehammer	d9387ae495	add option to disable block rewards	6 years ago
zachdaniel	75b558b500	feat: allow setting different configuration just for realtime fetcher	6 years ago
Paul Tsupikoff	3c338e193e	Increase HTTP timeout to 10min for prod env as well	6 years ago
Paul Tsupikoff	e13f6f8a8e	Use trace_replayBlockTransactions API for faster tracing	6 years ago
Ayrat Badykov	80002c6508	set correct log level for production	6 years ago
Ayrat Badykov	659c26d4a2	add logging	6 years ago
zachdaniel	c97ce0c9d8	feat: make replaced transactions disabled	6 years ago
zachdaniel	949a971c25	fix: import clique genesis blocks ... Additionally resolves a few small issues that arose in doing so	6 years ago
Luke Imhoff	81179f9459	Use :timer functions to make timeout values clearer	6 years ago
Luke Imhoff	3c0adace16	Include import_id and transaction_id in logger metadata ... When `import_id` and `transaction_id` was added in Logger calls, they were not added to the metadata allowed to be shown and so weren't appearing in the logs.	6 years ago
Luke Imhoff	65197f5913	Add shrunk to metadata ... Allow separating shrunk vs unshrunk to monitor how often shrinking occurs.	6 years ago
Luke Imhoff	2569d2595e	Move missing_block_range_count and missing_block_count out of prose ... Being in metadata will allow it to be graphed by tools.	6 years ago
Luke Imhoff	1af8f89001	Move step out of prose and into metadata	6 years ago
Luke Imhoff	ac35c4680f	Move error_count out of prose and into metadata ... Having count and error_count in the metadata would allow us to graph one vs the other to see how often we achieve partial retries vs full retries.	6 years ago
Luke Imhoff	63e646a5ff	Move count out of prose and into metadata ... Record the number of things being fetched in metadata instead of in text so that the count can be graphed.	6 years ago
Luke Imhoff	2010e90a71	Move block range out of prose and into metadata ... The catchup block range `first_block_number..last_block_number` will set `Logger.metadata(first_block_number: first_block_number, last_block_number: last_block_number)` for errors in `BoundIntervalSupervisor` and tasks in `Catchup.Fetcher`.	6 years ago
Luke Imhoff	0243726f9b	Move block number out of prose and into metadata ... Realtime block number will set `Logger.metadata(block_number: ...)` for each block number is fetches separately after getting the `newHead` websocket message.	6 years ago
Luke Imhoff	fed7d304e2	Include fetcher in logger metadata ... For each fetcher set the `Logger.metadata(fetcher: ...)` to a short semantic name. For Fetchers that use `BufferedTask`, `BufferedTask` now has an option to set `metadata` passed to `Logger.metadata/1` in 1. GenServer process 2. The `c:init/3` Task 3. The `c:run/2` Tasks	6 years ago