560 Commits (8fd8ba62b70659dadbb08e4dd3a72c06b9169854)

Author	SHA1	Message	Date
Ayrat Badykov	b9a6073597	mix format	6 years ago
Luke Imhoff	294c9f37e4	Convert UncatalogedRewards.Processor into a BufferedTask ... * Makes it works like the rest of the fetchers for consistency. * Allow it to participate in memory monitoring Bug Fixes * Addresses are created as needed for block rewards. * Coin Balances are created for each block and address mentioned. * Coin Balances are queues in CoinBalance.Fetcher. Enhancements * Fetch beneficiary errors no longer kill the block catchup, but instead only causes them to be async fetched while the rest of the block imports	6 years ago
Luke Imhoff	e0a19e906f	Ignore beneficiaries with different block hash ... Fixes #1337	6 years ago
Luke Imhoff	7098f4b78d	Use Explorer.Chain.import in Indexer.Block.UncatalogedRewards.Importer ... Ensures logic is consistent across Catchup, Realtime, and Uncatalogued fetchers.	6 years ago
Luke Imhoff	00e136e20c	Calculate gas payments for all blocks in batch in SQL	6 years ago
Luke Imhoff	ace3abf8df	Don't generate wei^2 from Wei.mult ... Wei.mult required both parameters to be Wei.t, but that meant it was actually yielding `wei^2` units. Fix the units by requiring the first parameter to be wei and the second to be a unitless integer, which makes more sense for the `gas_price * gas_used` usage as we expect that to be measured in wei and not wei^2.	6 years ago
Luke Imhoff	01ca7e9f8c	Optimize add_gas_payments	6 years ago
Luke Imhoff	3570436c33	Rename reward functions to match domain names ... * minted - reward directly from fetch beneficiaries that was minted for the new block. * gas payment - Wei paid to the validator by the transaction signers to cover the gas.	6 years ago
Luke Imhoff	8135fcafbd	Allow lists of block numbers instead of ranges for beneficiares ... Simplifies calling as numbers don't need to grouped into ranges when getting numbers from database.	6 years ago
Ayrat Badykov	359b2608fe	fix dialyzer	6 years ago
Ayrat Badykov	a4f2aee213	add ReplacedTRansaction fetcher to supervision tree	6 years ago
Ayrat Badykov	cf78b8cb80	move replaced transactions update to fetcher	6 years ago
Ayrat Badykov	3c1dd1d71f	remove replaced transactions fetcher	6 years ago
Ayrat Badykov	944e953351	mix format	6 years ago
Ayrat Badykov	fbcf7571b1	fix CR issues	6 years ago
Ayrat Badykov	9462939806	set default interval to 1 second	6 years ago
Ayrat Badykov	734583c1d2	fix compilation warnings	6 years ago
Ayrat Badykov	34d247875c	fix supervisor names	6 years ago
Ayrat Badykov	5bbb8c9b2e	add replaced transaction fetcher	6 years ago
zachdaniel	ec6c24e3e5	feat: add a minimum polling interval to protect from overrun	6 years ago
Ayrat Badykov	f9e63cff47	fix Code.Fetcher	6 years ago
Ayrat Badykov	33cbc6e4ab	set created_contract_code_indexed_at	6 years ago
Ayrat Badykov	3d0d0f6209	return async_import_internal_transactions	6 years ago
Ayrat Badykov	fdc57c8488	always run InternalTransaction.Fetcher	6 years ago
Ayrat Badykov	2d67e6faf5	fix dialyzer	6 years ago
Ayrat Badykov	2e94a0d2a6	return InternalTransaction.Fetcher	6 years ago
Ayrat Badykov	3520c7d8d7	fix address extraction for codes parameters	6 years ago
Ayrat Badykov	9852abae95	add catchup code fetcher	6 years ago
Ayrat Badykov	13ca7f4b25	do not fetch internal transaction from simple token transfer transactions	6 years ago
Ayrat Badykov	fbbdf78804	do not index internal transactions with simple token transfers ... 0xa9059cbb - signature of the transfer(address,uint256) function from the ERC-20 token specification. Although transaction input data can be faked we use this heuristics to filter simple token transfer internal transactions from indexing because they slow down realtime fetcher	6 years ago
zachdaniel	6bfc9cf4a6	fixup! fixup! fix: poll on import completion and only new blocks	6 years ago
zachdaniel	e3c4703a99	fixup! fix: poll on import completion and only new blocks	6 years ago
zachdaniel	c8fb42aba0	fix: poll on import completion and only new blocks	6 years ago
Luke Imhoff	57808d6b23	Separate usage of max consensus block number and block height ... The block height should be used when calculating confirmations while the max consensus block number when a block number is needed and you want to tell if the chain is empty or only the genesis block is available. The block height is 0 if there are no blocks or if there is only the genesis block.	6 years ago
Luke Imhoff	083e5d3278	Ensure min and max block number is for consensus blocks ... Adding `WHERE consensus = true` both fixes the bug that `min_block_number` and `max_block_number` were including non-consensus blocks, but it also makes the query faster because there is an index for consensus blocks. Times from Eth Mainnet production: ``` ether=> SELECT min(b0."number") FROM "blocks" AS b0; min ----- 0 (1 row) Time: 414.218 ms ether=> EXPLAIN SELECT min(b0."number") FROM "blocks" AS b0; QUERY PLAN ----------------------------------------------------------------------------------------------- Finalize Aggregate (cost=223454.95..223454.96 rows=1 width=8) -> Gather (cost=223454.73..223454.95 rows=2 width=8) Workers Planned: 2 -> Partial Aggregate (cost=222454.73..222454.74 rows=1 width=8) -> Parallel Seq Scan on blocks b0 (cost=0.00..215051.99 rows=2961099 width=8) (5 rows) Time: 1.040 ms ether=> EXPLAIN SELECT min(b0."number") FROM "blocks" AS b0 WHERE b0.consensus = true; QUERY PLAN ----------------------------------------------------------------------------------------------------------------------------- Result (cost=0.45..0.46 rows=1 width=8) InitPlan 1 (returns $0) -> Limit (cost=0.43..0.45 rows=1 width=8) -> Index Only Scan using one_consensus_block_at_height on blocks b0 (cost=0.43..158050.90 rows=7045520 width=8) Index Cond: (number IS NOT NULL) (5 rows) Time: 3.350 ms ether=> SELECT min(b0."number") FROM "blocks" AS b0 WHERE b0.consensus = true; min ----- 0 (1 row) Time: 1.059 ms ```	6 years ago
Ayrat Badykov	5c1fca9ac9	fix sigil formatting	6 years ago
Ayrat Badykov	9f45c14ef7	fix CR issues	6 years ago
Ayrat Badykov	60a36a4739	return polling to realtime fetcher	6 years ago
Luke Imhoff	5524a49725	Don't fetch internal transactions for simple token transfers ... Resolves #1303 Don't fetch internal transactions for transactions that have token transfers from the logs if the status is `:ok` and the transaction did not create a contract.	6 years ago
Luke Imhoff	1c915bdb3a	conflict_target and on_conflict for Block Rewards importer ... Fixes #1297	6 years ago
Luke Imhoff	a571a4edb3	Don't fetch or import internal transactions for value transfers ... Fixes #1287 For simple value transfers, the UI already doesn't show the redundant single internal transaction, but we can speed up the indexing by determine the internal transactions aren't needed when the transacion is a successful simple value transfer as determined by status being `:ok` and the input being empty (`0x`).	6 years ago
Luke Imhoff	6165f6757f	Move uniquifiation of address current token balances out of runner ... For all other runners, it is the responsibility of the caller to ensure unique entries. This ensures that the least amount of data as possible is sent to `Explorer.Chain.Import.all`, which speeds up the whole import process.	6 years ago
Gustavo Santos Ferreira	0b3e7f987d	genserver to find blocks without rewards and send them to the importer module	6 years ago
Gustavo Santos Ferreira	3a6751c3cc	importer module to import batches of block rewards	6 years ago
Luke Imhoff	e22fca4ada	Don't use step variable twice ... Accidentally used `step` variable twice when the actual error is like `{:import, {:error, import_step, ..., ...}` which would only allow `{:import, {:error, :import, ..., ...}`.	6 years ago
Luke Imhoff	3592b66340	Chunk pending transactions ... Fixes #1253 Ensure pending transaction import without timeout by chunking in case the node has a lot of pending transactions.	6 years ago
Luke Imhoff	8e1bfc0589	Convert DBConnection.ConnectionError tcp recv: closed to {:error, :timeout} ... Resolves #1251	6 years ago
Luke Imhoff	3bfc342941	Missed error pattern change in #1233	6 years ago
Luke Imhoff	cbe3308c3d	fetch_and_import_range_from_sequence log exceptions instead of raise ... Fixes #1234 Raising the exception will kill all Tasks, the sequence and the fetcher because of the linking from `Task.async_stream`. This leads to when 1 Task times out in a DB transaction, they all are affected, leading to slowdowns when the sequence has to be rebuilt when the fetcher restarts.	6 years ago
Luke Imhoff	adc03fd08b	Label all steps in Block.Fetcher implementations ... Fixes #1232 `{:error, :timeout}` should have been caught, but additionally, it should never have been allowed to propagate out unassigned to a step as it is not possible to track the timeout to a specific fetch.	6 years ago