741 Commits (abe392c947a7ccd8bf86a2d1511d632bbf3fd613)

Author	SHA1	Message	Date
Luke Imhoff	6abe66f7b1	Catch up index based on whether previous catch up found missing blocks ... When a catchup_index task completes without error, increase the interval until the next check by 2 if no blocks were missing and decrease it by 2 if blocks were missing. Minimum interval is the same as the realtime interval while the maximum interval is arbitarily chosen to be 10x the realtime interval.	6 years ago
Luke Imhoff	8f63f2a87c	Rename genesis task to catchup task ... It matches message (:catchup_index) used to trigger the task and reflects that the task to to catch-up the index to what the realtime task handles.	6 years ago
Luke Imhoff	b79d361909	Fix phrasing when genesis task completes	6 years ago
Luke Imhoff	d368159a09	Remove unused start_block_number in BlockFetcher state	6 years ago
Luke Imhoff	a6be2924b2	Running realtime task on interval ... Instead of scheduling the next realtime index in block_interval / 2 only after the previous one complete, run the realtime index every block_interval / 2 using `:timer.send_interval`. This ensures that the time it takes to complete the realtime index doesn't slowly build up, which is currently leading a missed block approximately every 15 blocks.	6 years ago
Luke Imhoff	3e09353d62	Fix typo	6 years ago
Luke Imhoff	f1e3c9e376	Use Task.Supervisor.async_nolink ... Task.Supervisor.async_nolink monitors the Task pid instead of linking, so it does the same thing as our Indexer.start_monitor.	6 years ago
Luke Imhoff	75e2bfccc0	realtime_interval -> block_interval / 2 ... The realtime_interval should be half of the block_interval to ensure that we don't get stuck in a state where we just miss a new block because using precisely the block rate doesn't account for processing time. The exact value of half the block_interval was chosen for the Nyquist rules.	6 years ago
Luke Imhoff	fe49a753d3	block_rate -> block_interval ... block_rate is measured in milliseconds / block, but a rate would blocks / unit-time, so rename block_rate to block_interval to reflect it is the interval between blocks.	6 years ago
Luke Imhoff	69a6bb65c8	Increase timeout for flaky test	6 years ago
Luke Imhoff	e3f7581572	Historical Address Balances	6 years ago
Amanda Sposito	3335817d90	Fix prod config file to use prod config instead of dev	6 years ago
Tim Mecklem	ee0e726fb4	Return addresses from bulk insert instead of address_hashes ... Co-authored-by: stamates <stamates@hotmail.com>	6 years ago
Tim Mecklem	9ce3f3d9e4	Hook up block confirmations to subscribed indexer update	6 years ago
Luke Imhoff	3432fe4c51	Disable logging debug_count at regular intervals ... Fixes #422 BlockFetcher's debug_count support used the slow `Explorer.Chain.*_count` functions. We want those counts to be completely accurate when needed, so we can't move to the `Explorer.Chain.*_estimated_count`. Since, the current, accurate counts are slowing down the indexing by causing a timeout to have to be handled, completely remove the debug count support and have developers call the `Explorer.Chain.*_count` when they need them to monitor progress.	6 years ago
Luke Imhoff	5b01cd396b	Check that ranges are in same direction as step	6 years ago
Luke Imhoff	105ce9b613	Only allow positive step for infinite sequences	6 years ago
Luke Imhoff	94d8267799	Don't allow Sequence to be started with a mix of ranges and infinite start ... We either use Sequence with a fixed set of ranges in finite mode when getting the missing blocks down to genesis or in infinite mode when using it for the realtime index. We can't completely separate the support for queuing ranges for the realtime index as that handles retries, but we can simplify the validation considerably by disallowing ranges and first to `start_link`.	6 years ago
Luke Imhoff	c409d63720	Allow first to be 0 ... It can be `0` when in finite mode, so allow it to be set to `0` to indicate that ahead of time.	6 years ago
Luke Imhoff	ded84c9633	Cap genesis sequence immediately ... Genesis sequence should only fetch the missing ranges	6 years ago
Luke Imhoff	a3d51f5e1a	Raise error if `:first` would cause retraversal	6 years ago
Luke Imhoff	15be505219	Move range chunking from BlockFetcher to Sequence ... Ensures that all callers benefit from chunking bug fixes, not just BlockFetcher.	6 years ago
Luke Imhoff	d7e6403bb7	Calculate comparator outside of loop	6 years ago
Luke Imhoff	2ca6ac9fa3	Unify chunk_range/3 when count > size	6 years ago
Luke Imhoff	9ee7ab64f5	Fix chunk_range/3 for descending ranges	6 years ago
Luke Imhoff	3a9dac846d	chunk_range/3	6 years ago
Luke Imhoff	308879d2ff	chunk_range	6 years ago
Luke Imhoff	7a530f2b9e	Fix off-by-1 errors in chunk_ranges	6 years ago
Luke Imhoff	ff11541bde	Failing regression tests for #340	6 years ago
Felipe Renan	e6775ed987	Fix Indexer Supervisor three ... We are facing this error when starting the `Indexer`: ``` ** (EXIT) an exception was raised: ** (ArgumentError) :json_rpc_named_arguments must be provided to `Elixir.Indexer.InternalTransactionFetcher.child_spec to allow for json_rpc calls when running. ``` It was missing the `json_rpc_named_arguments` to InternalTransactionFetcher children.	6 years ago
Luke Imhoff	8f827ecfa6	Use Mox by default for local integration tests ... How to run without Mox is in the root `README.md`. Run all combinations of Variant and Transport on CircleCI to ensure that Mox matches HTTP behavior, so Mox can be used for fast local testing: * Geth, HTTP * Geth, Mox * Parity, HTTP * Parity, Mox Using Mox locally also lessens load on Sokol and the Infura API key the tests use for Geth under the assumption that we do far more local testing than CI testing. May help with #340, but does not fix the root cause, which is now known as `Sequence` not chunking ranges correctly on retry.	6 years ago
Luke Imhoff	466c1e76f6	Request transport module and options for all JSONRPC calls ... To lessen load on Sokol chain nodes during testing and to allow substituting different transports than HTTP, such as IPC, in the future, pass the transport module and its options to any call to `EthereumJSONRPC.json_rpc`. This will allow us to use a `mox` module in local testing, so we only do true chain integration testing in CircleCI.	6 years ago
Luke Imhoff	a41cfaa4e8	Trap exits, so that Indexer.Sequence cleans up	6 years ago
Luke Imhoff	382406b347	Indexer.Sequence as GenServer	6 years ago
Luke Imhoff	bb10c02292	Failing regression test for #387	6 years ago
Luke Imhoff	5697cc7075	Fix {:error, :not_found} when starting indexer	6 years ago
Luke Imhoff	5ad0ed4571	Use tags to exclude Variant running incompatible tests	6 years ago
Luke Imhoff	1b06363eba	Handle partially-synced infura nodes in tests ... Some Geth nodes behind https://mainnet.infura.io are not fully-synced and so don't have historical address balances. Thankfully, the check that the max block number in a batch can still be done by checking the retry data.	6 years ago
Luke Imhoff	3c680ff953	Log, but do not fail tests, when 502 Bad Gateway occurs ... 502 Bad Gateway is an intermittent problem that needs to be fixed by ops when the JSONRPC servers are under heavy load, so they should not fail the test runs.	6 years ago
Luke Imhoff	4ecfb3b409	CircleCI tests for Geth	6 years ago
Luke Imhoff	c9e6366cb8	Use root formatter settings	6 years ago
Luke Imhoff	cac1cab39c	Geth receipts compatibility ... When testing transaction receipt processing using Geth against Ethereum Mainnet, a number of missing features were discovered: * Support for `to` and `from` addresses in receipts * The need to derive status for pre-Byzantium transactions by using the supplied gas from the transaction and the gasUsed in the receipt to check for out-of-gas.	6 years ago
Luke Imhoff	8b5327ad65	Remove public_key and standard_v from transactions ... public_key and standard_v is only exposed by Parity, so to allow for Geth compatibility, public_key and standard_v should be removed. If they are needed, they can be recovered from r, s, and v.	6 years ago
Luke Imhoff	904a63b504	Explorer.Chain.Hash.Truncated -> Explorer.Chain.Hash.Address ... Blocks nonce will also be a type of hash, but it is only 8-bytes, instead of 20-bytes, so the general name "Truncated" will be confusing, so name it "Address" to be specific.	6 years ago
Igor Florian	08ba537fe2	Set realtime interval to 5 seconds	6 years ago
Igor Florian	313fe94d6a	Real-time indexing starting from the last indexed Block	6 years ago
Luke Imhoff	6b3fd80916	Extract Explorer.Indexer to Indexer ... Resolves #304	7 years ago
Luke Imhoff	1c0bfe5eb0	Replacements	7 years ago
Luke Imhoff	768f2c14d5	Renames and delete ... Kept separate, so that git history remains continuous for changes and replacements.	7 years ago
Luke Imhoff	27b4bf62d5	mix new indexer --sup	7 years ago