636 Commits (191e8a66c5c4c9ac4470a7573cc2241af10907ec)

Author	SHA1	Message	Date
William Sanches	a754a72390	Add block_reward import	6 years ago
Luke Imhoff	6a0f625da7	Port fix for InvalidConsensus to Uncataloged ... They have a similar style where Uncataloged could also receive :queue_unavailable.	6 years ago
Luke Imhoff	c978b6168b	Don't log when queue is unavailable ... Fixes #1223 For large chains like ETH Mainnet, it is fairly common for the catchup fetcher to take a long time to calculate the missing block numbers and start the named Sequence used by `push_front(block)`. Since this is normal and not exceptional, `InvalidConsensus.Worker` shouldn't log this and retry silently.	6 years ago
Luke Imhoff	e4902fc479	Fix picking wrong clause for fetch_token_balances_from_blockchain ... Fixes #1215 The short-circuiting `[]` was not being used.	6 years ago
Luke Imhoff	5a0f02019b	Don't log errors when uncles aren't found ... Fixes #1221 It happens too often to be worth treating as an error as we should only log things that are exceptional and need human attention as errors.	6 years ago
Luke Imhoff	14c17cb2ee	Retry retried_entries for uncles ... `Indexer.Block.Uncle.Fetcher.retry/1` when there are errors did not actually retry the calculated `retried_errors` and instead only logged them. This didn't cause an unused variable warning because `retried_errors` is used in the Logger metadata. The `Task` for the `run/2` callback did not error because `Logger.error` returns `:ok`. To fix this problem, `{:retry, retried_errors}` need to be returned after the `Logger.error` call.	6 years ago
Luke Imhoff	30e0ac4498	Log timeout in PendingTransaction fetcher instead of crashing ... Fixes #1216	6 years ago
Luke Imhoff	65197f5913	Add shrunk to metadata ... Allow separating shrunk vs unshrunk to monitor how often shrinking occurs.	6 years ago
Luke Imhoff	2569d2595e	Move missing_block_range_count and missing_block_count out of prose ... Being in metadata will allow it to be graphed by tools.	6 years ago
Luke Imhoff	1af8f89001	Move step out of prose and into metadata	6 years ago
Luke Imhoff	ac35c4680f	Move error_count out of prose and into metadata ... Having count and error_count in the metadata would allow us to graph one vs the other to see how often we achieve partial retries vs full retries.	6 years ago
Luke Imhoff	63e646a5ff	Move count out of prose and into metadata ... Record the number of things being fetched in metadata instead of in text so that the count can be graphed.	6 years ago
Luke Imhoff	2010e90a71	Move block range out of prose and into metadata ... The catchup block range `first_block_number..last_block_number` will set `Logger.metadata(first_block_number: first_block_number, last_block_number: last_block_number)` for errors in `BoundIntervalSupervisor` and tasks in `Catchup.Fetcher`.	6 years ago
Luke Imhoff	0243726f9b	Move block number out of prose and into metadata ... Realtime block number will set `Logger.metadata(block_number: ...)` for each block number is fetches separately after getting the `newHead` websocket message.	6 years ago
Luke Imhoff	fed7d304e2	Include fetcher in logger metadata ... For each fetcher set the `Logger.metadata(fetcher: ...)` to a short semantic name. For Fetchers that use `BufferedTask`, `BufferedTask` now has an option to set `metadata` passed to `Logger.metadata/1` in 1. GenServer process 2. The `c:init/3` Task 3. The `c:run/2` Tasks	6 years ago
Sebastian Abondano	c762719ba0	Ensures consensus is valid for parent blocks ... Why: * We noticed some blocks with invalid consensus values on Goerli. * Issue link: https://github.com/poanetwork/blockscout/issues/1181 This change addresses the need by: * Editing the realtime fetcher to check, after insertion to DB, a block's parent consensus value and trigger a refetch for that block number if consensus is `FALSE`. * Creating `Indexer.Block.Realtime.ConsensusEnsurer` module, where logic to ensure a given block has consensus lives. * Adding `list_block_number_with_invalid_consensus/0` to `Explorer.Chain` to get block numbers with invalid consensus from DB. * Adding `Indexer.Block.InvalidConsensus.Worker` to find blocks with invalid consensus and queue them for refetching.	6 years ago
Sebastian Abondano	532a0a97bb	Fix realtime indexer's 'no skips prevention' bug ... Why: * For the realtime indexer's logic that fills in skipped block numbers to account for reorgs. See issue for details and examples. * Issue link: https://github.com/poanetwork/blockscout/issues/1189 This change addresses the need by: * Editing the realtime fetcher to keep track of the max block number seen. * Editing realtime fetcher's `start_fetch_and_import` function to only fill in for skipped block numbers when the block number received from the `newHeads` subscription is not a reorg. A reorg in this case is defined as a block number that is less than or equal to the max block number the realtime fetcher has seen. * Editing realtime fetcher's `fetch_and_import_block` function to wait 5 seconds if the block number given for it to fetch is a reorg. This is useful to improve the chance that the latest fetched block for a given number gets consensus. E.g. when goerli's `newHeads` sends two identical block numbers at virtually the same time: `100, 101, 101, 102, 103`, we want to increase the chance taht the second attempt at fetching 101 gets consensus.	6 years ago
Luke Imhoff	c7d614e2ec	Include date in addition to time in log format	6 years ago
Sebastian Abondano	0204d08fba	Fix realtime indexer's 'no skips prevention' bug ... Why: * For the realtime indexer's logic that fills in skipped block numbers to account for reorgs. See issue for details and examples. * Issue link: https://github.com/poanetwork/blockscout/issues/1189 This change addresses the need by: * Editing the realtime fetcher to keep track of the max block number seen. * Editing realtime fetcher's `start_fetch_and_import` function to only fill in for skipped block numbers when the block number received from the `newHeads` subscription is not a reorg. A reorg in this case is defined as a block number that is less than or equal to the max block number the realtime fetcher has seen. * Editing realtime fetcher's `fetch_and_import_block` function to wait 5 seconds if the block number given for it to fetch is a reorg. This is useful to improve the chance that the latest fetched block for a given number gets consensus. E.g. when goerli's `newHeads` sends two identical block numbers at virtually the same time: `100, 101, 101, 102, 103`, we want to increase the chance taht the second attempt at fetching 101 gets consensus.	6 years ago
zachdaniel	5d12613f70	feat: support tracing via spandex	6 years ago
Sebastian Abondano	1bdb8c1166	Ganache ignores internal transactions ... Why: * We were using the `EthereumJSONRPC.Geth` variant for Ganache but we recently learned that it doesn't support the `tracer` option for [debug_traceTransaction](https://github.com/ethereum/go-ethereum/wiki/Management-APIs#debug_tracetransaction). This `tracer` option is what we currently use to fetch internal transactions for Geth. This was the cause of errors as shown on issue 1152 (link below). * Issue link: https://github.com/poanetwork/blockscout/issues/1152 This change addresses the need by: * Creating `EthereumJSONRPC.Ganache`. It ignores fetching beneficiaries, internal transactions, and pending transactions. * Editing ganache config to use the `EthereumJSONRPC.Ganache` variant instead of `EthereumJSONRPC.Geth`. * Updating inaccurate doc in `EthereumJSONRPC.Geth`. It previously said fetching internal transactions was not supported for Geth which is inaccurate.	6 years ago
Luke Imhoff	3499155cdb	Partial retries for fetch_blocks_by_range ... Means that both Block.Fetchers, realtime and catchup, now handle fetch errors. The Block.Catchup.Fetcher will retry those blocks that failed to fetch while importing the rest that did fetch instead of refetching the whole batch.	6 years ago
Luke Imhoff	d43a8c6133	Partial retry of batches of blocks by hash	6 years ago
Luke Imhoff	ad1119eb4c	Fetched Beneficiaries partial batch retries	6 years ago
Luke Imhoff	3efa2d9996	Partial retries for CoinBalance.Fetcher	6 years ago
svenski123	3b45474e36	Update address extraction testcases	6 years ago
svenski123	29199eb54e	Add nonce field to Address object and addresses table. ... This caches the highest nonce value seen for sent transactions for a given address. The top addresses query no longer needs to scan the transactions table for nonce values. The database migration script adds the nonce field to the addresses table and sets the nonce value according to the contents of the transactions table.	6 years ago
Andrew Cravenho	bd769c6724	Fix core tests	6 years ago
Andrew Cravenho	a64a1dc6bb	Update sokol node tests	6 years ago
Andrew Cravenho	2cb7f4b0c7	Update README and change default variant to ganache	6 years ago
Andrew Cravenho	c1d1ad996c	Change the sokol node to localhost	6 years ago
Andrew Cravenho	063c393281	Update documentation replacing old sokol nodes	6 years ago
Andrew Cravenho	72480f2389	Remove old sokol node from prod env	6 years ago
Andrew Cravenho	0595c8cbaa	Replace dev sokol node with personal node	6 years ago
Amanda	3c146f92e4	Add test to MetadataUpdater's GenServer ... Co-Authored-By: w-sanches <1727723+w-sanches@users.noreply.github.com>	6 years ago
William Sanches	421262a2da	Fix credo and format issues	6 years ago
William Sanches	2df87c2cd1	Refactor metadata_updater to get interval on start	6 years ago
William Sanches	5b14292aa9	Fix reducer function on metadata updater ... It was concatenating the result in the reverse order.	6 years ago
William Sanches	3528e4dc51	Add metadata updater	6 years ago
Felipe Renan	d627e700d9	Increase the timeout to 15s in Indexer.TokenBalances	6 years ago
Felipe Renan	321a93da88	Standardize Realtime to a list of token balances	6 years ago
Felipe Renan	e26a0aab93	Improve TokenBalance.Fetcher docs	6 years ago
Felipe Renan	c97d7c1572	Handle empty list in Indexer.TokenBalances	6 years ago
Felipe Renan	e2827ba907	Log token balances that raised errors	6 years ago
Felipe Renan	a79fa5b3e4	Add retry feature to the TokenBalance.Fetcher ... As some token balances always will raise errors interacting with the Smart Contract, we have to ignore them. Otherwise, we will accumulate a lot of toke balances in the indexer memory that never will be fetched.	6 years ago
Felipe Renan	10821e6b0b	Rename FunctionsReader to MetadaRetriever ... Also: * Renaming `fetch_functions_from_contract` to `fetch_functions_with_retries` * Using pattern matching instead of guard in `fetch_functions_with_retries`	6 years ago
Felipe Renan	477de645fb	Refactor Indexer.Token.Fetcher ... This refactor aims to remove the responsability of reading functions from the Smart Contract from Token.Fetcher. Now, we have the module Explorer.Token.FunctionsReader that is responsible for it.	6 years ago
Luke Imhoff	e4b7a4ee5f	Geth internal transactions ... Get internal transactions using debug_traceTransaction and a custom tracer. The tracer was based on the callTracer that ships with Geth, but rewritten to break it into more functions with more explicit purpose and to patch some holes in callTracer: * All calls have gas and gasUsed, which patches the hole in callTracer for handling `DELEGATECALL`. * All calls have value, which patches the hole in callTracer for handling `DELEGATECALL` and `STATICALL`. Since the tracer needed to be resubmitted in whole anyway, it was further customized to match the format needed for internal transactions: * Instead of returning the `op` as `type`, the `type` and `callType` used for internal transactions is returned. * Instead of returning a call tree, the tree is walked in pre-order, displaying the parent call before its nested calls to match the flat order returned from parity's trace_transaction.	6 years ago
Luke Imhoff	9cce7ab661	Adopt EIP-6 ... Geth has EIP-6, while Parity does not, but the Ethereum Yellow Paper includes EIP-6, so it is better to use EIP-6 when looking up community docs.	6 years ago
Gustavo Santos Ferreira	c50d77d233	upsert addresses along with their token balances	6 years ago