23 Commits (132a43ccd526ae12254d5425e5348d828653bb89)

Author	SHA1	Message	Date
Luke Imhoff	6b3fd80916	Extract Explorer.Indexer to Indexer ... Resolves #304	7 years ago
Luke Imhoff	e44a617a55	Rechunk batch JSONRPC request when 413 is returned ... When status 413 Request Entity Too Large is returned from JSONRPC, we can split the batch in half and try again. Continuing to break up the chunks of the batch until we suceed or hit 1 request in the chunk, in which case we still need to error.	7 years ago
Luke Imhoff	c7a80fb75b	Convert eth_getBalance error responses to error tuple	7 years ago
Luke Imhoff	3e5e6c95c4	Pass through removed flag for logs ... Fixes #314 Parity 1.11.4 sends a `removed` flag of whether a transaction was removed or not in the transaction receipt that was not sent in 1.10.6. As the flag value is already `true` or `false`, no conversion is necessary when converting to Elixir.	7 years ago
Luke Imhoff	f7d79b666a	Handle error responses from trace_replayTransaction ... Conver error responses to error tuple with multiple reasons.	7 years ago
Luke Imhoff	0680973e64	fetched_balance_block_number instead of fetched_balance_at ... Fixes #243 Instead of getting the address balance at the latest block and recording the timestamp of the insert, which is only loosely correlated with even the latest block's timestamp on-chain, use the block number for the last time an address was used in the indexed address foreign keys in the chain: * blocks * miner_hash * internal_transactions * created_contract_address_hash * from_address_hash * to_address_hash * logs * address_hash * transactions * from_address_hash * to_address_hash To gather `fetched_balance_block_number` on reboot, `Explorer.Chain.stream_unfetched_addresses` queries across the above columns for the `MAX(blocks.number)`, which is used in `Explorer.Indexer.AddressBalanceFetcher.init/2`. During indexing, `Explorer.Indexer.AddressBalanceFetcher.async_fetch_balances/1` now requires a list of `%{block_number: Block.block_number(), hash: Hash.Truncated.t()}` instead of list of `Hash.Truncated.t()`. Having a `block_number` available for all importable entities's addresses required changing `Explorer.Indexer.AddressExtraction` to extract the `block_number` too. The use of `insert` in the factories was making tests that show the count not make sense, so the factories were switched to `build` because it means only the exact count is created when a default value is overridden. This does, unfortunately, mean that `params_for(factory)` no longer generates foreign keys and they must be set explicitly OR the association passed instead of the foreign key. Allow nil extracted fetched_balance_block_number when pending transaction *NOTE*: This is a database drop and reindex change.	7 years ago
Luke Imhoff	d3ea7c251a	Fetch pending transactions ... Use `parity_pendingTransactions` JSONRPC to get the pending transactions and import them. If they conflict with pre-existing transactions, then the previous transactions win, under the assumption that sometimes pending transactions repository transaction will COMMIT after the the realtime index has COMMITed that same transaction being validated as the timeout for transactions is 60 seconds while the block rate is faster than that.	7 years ago
Luke Imhoff	c98afd5bbb	Allow pending transactions in Transaction.to_elixir ... Pending transactions have nil for "blockNumber" and "blockHash", which broke `quantity_to_integer`, so for those keys, check if `nil` and pass through. For others, check that the value is not `nil` as it gives a better error message with both the key and value instead of just the nil value passed to quantity_to_integer as happened before.	7 years ago
Luke Imhoff	394df24ea2	Use EthereumJSONRPC.request in EthereumJSONRPC.Parity	7 years ago
Luke Imhoff	308c899379	Index from latest to genesis ... Reverse the genesis index order as most users will care about recent blocks as opposed to the very beginning of the chain. This should shorten the Time-to-Usefulness.	7 years ago
Luke Imhoff	805afcd536	Start realtime index immediately from latest block on boot.	7 years ago
Luke Imhoff	a025091af1	Extract common request code	7 years ago
Luke Imhoff	d2c1dc3696	Remove unused eth_*Filter functions	7 years ago
Luke Imhoff	240be361b8	handle_get_block_by_number -> handle_get_block ... `handle_get_block_by_number` handles the result from both `fetch_blocks_by_number` AND `fetch_blocks_by_number`, so it isn't handling just the `_by_number` result and is a misnomer.	7 years ago
Luke Imhoff	beea8f5a60	Denormalize blocks.number into transasctions.block_number ... Allows to use a sorted index for `Explorer.Chain.recent_collated_transactions`, which speeds up the query 600x with 1000 blocks with 100 transaction each and the speed up appears to only grow as more blocks and transactions per block is used.	7 years ago
Luke Imhoff	f9c026202d	Fold receipts into transactions ... `Explorer.Chain.Receipt`s are never shown in isolation from `Explorer.Chain.Transaction`s and `Explorer.Chain.Transaction`s are used for pending and collated transactions, so move all collated-only fields from `Explorer.Chain.Receipt`s to `Explorer.Chain.Transaction`s. Remove `receipts` table completely: its migration is removed. **THIS IS A DB RESET AND REINDEX CHANGE.**	7 years ago
Luke Imhoff	6749e15cb8	Transaction v as integer ... Documentation I can find say v should be between 27 and 30 with 29 and 30 being rare, but there are some values of 189 and 190 from Sokol, so we can't constrain the value now.	7 years ago
Luke Imhoff	3f7a737238	standard_v is a smallint (2 bytes) that must be between 0 and 3	7 years ago
Luke Imhoff	9e24b3b0d3	Convert transactions r and s to decimal	7 years ago
Luke Imhoff	a96f05d065	Store variable-length DATA as Explorer.Chain.Data ... Explorer.Chain.Data is like `Explorer.Chain.Hash`, but of variable width.	7 years ago
Luke Imhoff	c496e5f43a	Remove double backticks not flagged by earmark	7 years ago
Luke Imhoff	11bcecad96	Explorer.JSONRPC -> EthereumJSONRPC ... Extract Explorer.JSONRPC to its own OTP application, apps/ethereum_jsonrpc. It is not ready to be a completely separate library because it knowns the internal params format used for Explorer.Chain.	7 years ago
Luke Imhoff	75388c8ece	cd apps; mix new ethereum_jsonrpc	7 years ago