229 Commits (8fd8ba62b70659dadbb08e4dd3a72c06b9169854)

Author	SHA1	Message	Date
Alex Garibay	d7e38a223e	Missed token transfer cataloger (#807) ... * Rename token transfer params parser * Rename token transfer parsing function * Requeue blocks with incomplete token transfer indexing on start up * Add additional test for worker * Add missed token transfers to the front of the catchup queue * Address code review concerns * Remove unused alias * Add process names for uncataloged token transfer processes * Improved handling of when sequence isn't avaialbe to queue * Move Uncataloged.Supervisor name out of init and into start_link call Name is not a valid option to init as it is a GenServer.option, which means it is passed to the 3rd argument to Supervisor.start_link.	6 years ago
Felipe Renan	cc89b1f6db	Ignore burn address token balance for Tokens ERC-721 ... As we always get errors trying to fetch token balances when the address is the burn addres for Tokens ERC-721, we are gonna ignore them when we are processing the token balances from the token transfer.	6 years ago
Luke Imhoff	b8d9edf97d	Indexer.Block.Catchup.BoundIntervalSupervisor is proper supervisor ... Fixes #592 Ensure that Indexer.Block.Catchup.BoundIntervalSupervisor acts as a proper Supervisor by ensure it supports all Supervisor and :supervisor functions.	6 years ago
Luke Imhoff	8e8b4b5508	Indexer.Block.Uncle.Fetcher ... * Use `Explorer.Chain.stream_unfetched_uncle_hashes` to initialize queue. * Have `Indexer.Block.Catchup.Fetcher` and `Indexer.Block.Realtime.Fetcher` queue uncles to fetch by calling `Indexer.Block.Uncle.Fetcher.async_fetch_blocks`.	6 years ago
Luke Imhoff	4b140c87df	Block in the consensus chain marked consensus true	6 years ago
Luke Imhoff	96d5aea311	Block.SecondDegreeRelation ... The database table block_second_degree_relations contains links between the `uncle_hash` of the uncle and the `nephew_hash` of the block that said `uncle_hash` was an uncle. It also has a `uncle_fetched_at` that is `null` until the `uncle_hash` is confirmed as fetched in the database. This does not contain such a fetcher.	6 years ago
Luke Imhoff	48b302f935	Return uncles from EtherumJSONRPC.Block.elixir_to_params	6 years ago
Igor Florian	52e861fa73	Include and Log token_balances error attribute	6 years ago
Lucas Narciso	d8b22f6988	Handle large strings when fetching tokens	6 years ago
Amanda Sposito	b4a66ad7f0	Add treatment to TokenBalance.Fetcher when there is an error with the import data ... * The TokenBalanceFetcher was not considering empty lists and errors when trying to import the data into the database.	6 years ago
Alex Garibay	56299e308b	Add support for ERC-721 token transfer logs with addresses in `data`	6 years ago
Luke Imhoff	1a8bb6cbed	Restructure Indexer.BlockFetcher to match other Fetchers ... Move the "Fetcher" part below the "time" part of "Realtime" or "Catchup", so that the "Fetcher" and "Supervisor" are siblings like in the fetchers that don't have a "time" part.	6 years ago
Luke Imhoff	09051ceb8a	Separate usage of Task.Supervisor ... Have a separate subtree for each fetcher with a supervisor supervising the fetcher and a Task.Supervisor that is only used by the fetcher, so that looking at the Task.Supervisor in that subtree will show which fetcher is causing any memory, message, or blocking problems.	6 years ago
Felipe Renan	6148658f61	Store tokens with invalid strings in Token indexer. ... It's a temp fix for https://github.com/poanetwork/blockscout/issues/669. For now, we are going to store those tokens that have names and/or symbols invalids considering: - the first 6 characters from the contract address hash for the name. - nil for the symbol.	6 years ago
Stamates	18380efe0a	fix broken tests ... Co-authored-by: Luke Imhoff <luke.imhoff@dockyard.com>	6 years ago
Felipe Renan	e86c5c79f3	Handle timeout when fetching token balances from blockchain	6 years ago
Igor Florian	7077a41576	Change Address fetched_balance's columns to fetched_coin_balace	6 years ago
Igor Florian	acf14d6cf3	Rename Balance references to Address.CoinBalance	6 years ago
Igor Florian	c640bf2de1	Rename AddressBalanceFetcherCase to CoinBalanceCase	6 years ago
Igor Florian	8e0f8b2e92	Rename BalanceFetcher to CoinBalanceFetcher	6 years ago
Igor Florian	2a7c2feac2	Rename Balances module to CoinBalances	6 years ago
Felipe Renan	d7bfcd1e87	Change Address.TokenBalance value to be decimal ... It was being created as WEI, but the correct type is decimal such as we are doing with Token and Token Transfers.	6 years ago
Felipe Renan	01af13e325	Include TokenBalanceFetcher to Indexer.Supervisor test support	6 years ago
Igor Florian	53e7866016	Fetch TokenBalances value in the Catchup Indexer	6 years ago
Igor Florian	c2ff17756c	Get TokensBalance in the Blockchain ... We're now able to get the balances from a Address given it's address_hash, block_number and token_contract_address_hash.	6 years ago
Luke Imhoff	c484bc2d25	Separate Indexer.Address.TokenBalances from Indexer.Balances ... TokenBalances need to extract 3 fields, while Balances only need 2, so they shouldn't be mixed together in the same module since the expected params in the set differs.	6 years ago
Luke Imhoff	64585c4938	Insert all BufferedTaskTest assert_receive timeouts to 200ms	6 years ago
Luke Imhoff	c8c53405fc	Subscribe to newHeads for realtime indexer ... Separate Catchup and Realtime indexer's fetching, so that Catchup continues to use the old polling, `EthereumJSONRPC.json_rpc` while Realtime subscribes with `EthereumJSONRPC.subscribe`. Because Realtime gets notified of new blocks through the subscription, it no longer has a Sequence, so Sequence has been removed from `%BlockFetcher{}`. There is also no block concurrency or block batch size for Realtime, so that was removed from `%BlockFetcher{}` too and moved to `%BlockFetcher.Catchup{}`. Because Realtime requires a websocket to be connected, there is now an `Indexer.BlockFetcher.Realtime.Supervisor` that supervises the `Indexer.BlockFetcher.Realtime.WebSocket` and `Indexer.BlockFetcher.Realtime`. `Indexer.BlockFetcher.Realtime` because it is waiting on notifications from is subscription becomes a `GenServer` insteado of a `Task`, so it can be supervised normally. BlockFetcher.Supervisor becomes a normal `Supervisor` of `Catchup.Supervisor` and `Realtime.Supervisor`. As Realtime is using `EthereumJSONRPC.subscribe`, `subscribe_named_arguments` has been added as a sibling of `json_rpc_named_arguments` in the `:indexer` `config`s.	6 years ago
Luke Imhoff	ae21b7e8b0	Separate sequence from BlockFetcher.t ... Move code dealing with the Sequence to the outer most layer, so that Realtime can stop using it when switching to WebSocket.	6 years ago
Luke Imhoff	0873bcdc28	Disable BlockFetcher.SupervisorTest for Geth ... Opened https://github.com/poanetwork/blockscout/issues/597 to re-enable later. This is blocking too many PR merges.	6 years ago
Andrew Cravenho	28e485a5c1	Replace poanetwork/poa-explorer urls with poanetwork/blockscout	6 years ago
Luke Imhoff	f24d2a8d0c	Sleep before checking for DOWN	6 years ago
Luke Imhoff	24c2d8e24e	Use nil value to indicate unfetched Balance ... Balances will be created when a given (address_hash, block_number) is first seen, but with a `nil` value. The BalanceFetcher will stream this value is `NULL` rows on restart to initialize the queue.	6 years ago
Alex Garibay	8b16f81b73	Catalog token transfers and tokens during indexing (#484) ... * Fetch token information asynchronously during indexing * Include token transfers imports in main importer * Extract token transfers when importing blocks while indexing * Move ecto to explorer deps * Update References to the Indexer namespace * Add token insertions with main importer * Import token address/type during block indexing	6 years ago
Luke Imhoff	81ba3a5b7b	Only use address_hash_to_block_number if block_number is missing	6 years ago
Luke Imhoff	1225bc2f74	Regression test for https://github.com/poanetwork/poa-explorer/pull/489#issuecomment-409637329	6 years ago
Luke Imhoff	f2884992a7	Fetch realtime internal transactions and balances synchronously ... Fixes #366 Queuing the internal transactions and balances to be fetched asynchronously for realtime blocks lead to upto 15 minute delay between when a block appeared and the internal transaction was drained from the queue. It is a better user experience to not see the realtime blocks at all than to see them incomplete, so fetch the internal transactions and then the balances before importing the whole tree of data instead of using the catchup asynchronous queues.	6 years ago
Luke Imhoff	11735b1289	Separate Catch, Realtime, Supervisor, and BlockFetcher states ... BlockFetcher.Catchup and BlockFetcher.Realtime get their own structs, which use BlockFetcher struct. This better emphasizes that Catchup and Realtime are both block fetchers. The BlockFetcher.Catchup and BlockFetcher.Realtime structs move into Supervisor's struct.	6 years ago
Luke Imhoff	2333cc6cf5	Separate supervision and fetching parts of BlockFetcher ... Move supervision aspect to BlockFetcher.Supervisor and leave only the actual fetching code in BlockFetcher.	6 years ago
Luke Imhoff	e0fed23fad	Fix catchup_block_number not being set ... catchup_block_number can't be set in state because it is set in a separate task, so have the Task return it instead of storing it in a state field.	6 years ago
Luke Imhoff	062ebd9463	Remove unreliable test	6 years ago
jimmay5469	e5e695331f	Subscribe to only realtime-indexer events for channel broadcasts	6 years ago
Luke Imhoff	6abe66f7b1	Catch up index based on whether previous catch up found missing blocks ... When a catchup_index task completes without error, increase the interval until the next check by 2 if no blocks were missing and decrease it by 2 if blocks were missing. Minimum interval is the same as the realtime interval while the maximum interval is arbitarily chosen to be 10x the realtime interval.	6 years ago
Luke Imhoff	69a6bb65c8	Increase timeout for flaky test	6 years ago
Luke Imhoff	e3f7581572	Historical Address Balances	6 years ago
Tim Mecklem	ee0e726fb4	Return addresses from bulk insert instead of address_hashes ... Co-authored-by: stamates <stamates@hotmail.com>	6 years ago
Tim Mecklem	9ce3f3d9e4	Hook up block confirmations to subscribed indexer update	6 years ago
Luke Imhoff	3432fe4c51	Disable logging debug_count at regular intervals ... Fixes #422 BlockFetcher's debug_count support used the slow `Explorer.Chain.*_count` functions. We want those counts to be completely accurate when needed, so we can't move to the `Explorer.Chain.*_estimated_count`. Since, the current, accurate counts are slowing down the indexing by causing a timeout to have to be handled, completely remove the debug count support and have developers call the `Explorer.Chain.*_count` when they need them to monitor progress.	6 years ago
Luke Imhoff	5b01cd396b	Check that ranges are in same direction as step	6 years ago
Luke Imhoff	105ce9b613	Only allow positive step for infinite sequences	6 years ago