1683 Commits (38f77d7019489003d8b60ee4998b5bad1d707734)

Author	SHA1	Message	Date
Sebastian Abondano	2b8ceb4e32	Update block reward contract beneficiary balances ... Why: * "Parity’s consensus engine allows using a smart contract for block reward calculation." - see https://wiki.parity.io/Block-Reward-Contract for details. This means that we need to use `trace_block` (https://wiki.parity.io/JSONRPC-trace-module#trace_block) to fetch the block reward contract beneficiaries and update their balances. Currently this doesn't happen so there are addresses (block contract reward beneficiaries) with inaccurate balances and missing rows in the `address_coin_balances` table. * Issue link: https://github.com/poanetwork/blockscout/issues/767 This change addresses the need by: * Adding `EthereumJSONRPC.fetch_beneficiaries/2` to help us fetch the block reward contract beneficiaries of a given block range. This only works with Parity. * Editing Indexer's dev and prod config by adding `trace_block` config to `:method_to_url`. * Adding `block_reward_contract_beneficiaries` to `Indexer.AddressExtraction` for it to know how to get addresses in this scenario. * Editing `Indexer.Block.Fetcher.fetch_and_import_range/2` to get block reward contract beneficiaries, create their addresses if they don't yet exist, and update their coin balances.	6 years ago
Felipe Renan	bed1a730dd	Consider mint transfers in the logs to index the address	6 years ago
Alex Garibay	c60bd06e5e	Add bare admin panel (#927) ... * Add router for admin routes * Add mechanism for having a generated admin recovery key * Add admin panel to web interface Web portion now includes a set of routes exclusive for managing a BlockScout instance. Whenever an instance hasn't been configuration, a user will be prompted with a page to setup their instance. Once they've followed the steps and registered, the user will be able to perform administrative tasks.	6 years ago
Lucas Narciso	518b17e053	Generate gettext	6 years ago
Lucas Narciso	ea3da7fd07	Consolidate Token Holders count info ... The number of token holders is now available in the token page again. It is cached by the TokenHoldersCounter GenServer that periodically updateds an ETS with all pairs of tokens and token holders.	6 years ago
Lucas Narciso	234128a923	Avoid redundant calculation of @burn_address_hash ... Use the available @burn_address_hash module attribute instead of calculating this value again in token_holders_query/1.	6 years ago
Luke Imhoff	1100f56fa1	Test WebSocketClient with cowboy_websocket_handler ... Allows to properly simulate TCP disconnect.	6 years ago
Luke Imhoff	b1f4696569	Reconnect, rerequest, and resubscribe when websocket disconnects ... * Use struct, `%EthereumJSONRPC.WebSocket.WebSocketClient.Options{}` to hold `web_socket_options`. * `%EthereumJSONRPC.WebSocket.Registration{}` * Record `t:EthereumJSONRPC.request/0` in `%EthereumJSONRPC.WebSocket.Registration{}`, so that the request can be re-requested if the websocket disconnects and reconnects. * Drop server-side `subscription_id` from `%EthereumJSONRPC.WebSocket.Registration{}` as it can retrieved from `request` now. * `EthereumJSONRPC.WebSocket.WebSocketClient` * Track whether the web socket is connected or not, so that requests aren't sent when in the disconnected state. This prevents double-sends as `handle_call` can be called before `onconnect`, which caused that first subscribe to be sent twice. * Instead of the subscriber knowing the server-side subscription id, an opaque `t:reference/0` is used, so that the reference is stable in the subscriber's `%Subscription{}`, but the subscription ID can change on reconnect, which means replacing `subscription_id_to_subscription` in `%WebSocketClient{}` with 3 maps 1. `subscription_id_to_subscription_reference` - used translate server-side, per-connection subscription to the stable reference in `subscription_reference_to_subscription` 2. `subscription_reference_to_subscription_id` - used to convert stable reference to subscription id to unsubscribe. 3. `subscription_reference_to_subscription` - used to get full Subscription, including the subscriber_pid for when subscription messages are delivered or the subscription needs to be resubscribed using the `web_socket_options`. * `ondisconnect`, `:reconnect` immediately. * When disconnecting, tell unsubscribers they were successful. * Hold any json_rpc or subscribe requests to retry on reconnect. * Hold any subscriptions to resubscribe on reconnect. * `onconnect` * re-request the saved json_rpc and subscribe requests. * issue new requests to re-establish the subscriptions that had already succeeded in their subscribe requests. * `%EthereumJSONRPC.Subscription{}` * Replace `id`, which did match the server created ID, with a `t:reference/0`, which allows for indirection and for the server created ID to change on reconnect while the subscriber does not need to care about the reconnections. * `EthereumJSONRPC.WebSocket` * `options` is switched from a Keyword.t to a struct, `t`, so that it is easier to pattern match for the reconnect logic in `WebSocketClient`. * `web_socket_options` is no longer a generic `term` because the code did require it to be a map with a `:web_socket` key for the `t:GenServer.server/0`.	6 years ago
Luke Imhoff	32535bd73c	Simplify WebSocketClient.respond_to_registration ... All clauses set request_id_to_registration in state to new_request_id_to_registration, so it does not need to be passed. The catchall cause does the equivalent because new_request_id_to_registration was request_id_to_registration already as Map.pop popped nothing.	6 years ago
Felipe Renan	54de3f985f	Fix the Address page to count only transactions sent	6 years ago
Felipe Renan	fa5c92e8d6	Generate gettext	6 years ago
Felipe Renan	7f56c76ff9	Refactor transactions count by address ... Now, the app is going to count how many transactions an specific address has sent instead of an estimated count. The reasons why we are doing that are: - we have a inaccurate count (bad user experience) - it's slower As we already store the nonce when the app index transactions, we can query this value by address to know how many transactions the address has sent.	6 years ago
Konstantin Zolotarev	ff8053d656	fix formatting	6 years ago
Konstantin Zolotarev	3eee0a2944	Fix spacing	6 years ago
Konstantin Zolotarev	0604f7a234	Fixes for pr comments	6 years ago
Konstantin Zolotarev	f89a27adf4	Fixes for ganache integration	6 years ago
Luke Imhoff	3284388120	Get transaction created_contract_address_hash from first internal ... Fixes #593 Fixes #621 Fixes #920 `created_contract_address_hash` should be treated like `error` and `status`, where only the first internal transaction matters.	6 years ago
Luke Imhoff	8bb151da71	Log and retry import errors in uncle fetcher	6 years ago
Luke Imhoff	fcf5e6ef99	InternalTransaction.Fetcher buffer tuples instead maps ... ```elixir test "memory" do InternalTransaction.Supervisor.Case.start_supervised!(json_rpc_named_arguments: []) pid = Process.whereis(InternalTransaction.Fetcher) Stream.repeatedly(fn -> %{block_number: block_number(), hash: transaction_hash()} end) |> Enum.take(100) |> InternalTransaction.Fetcher.async_fetch() Process.info(pid, :memory) |> elem(1) |> IO.inspect(label: "BEFORE GC") :erlang.garbage_collect(pid) Process.info(pid, :memory) |> elem(1) |> IO.inspect(label: "AFTER GC") end ``` | Balances | Garbage Collection | Map (bytes) | Tuple (bytes) | Tuple / Map (%) | |----------|--------------------|-------------|---------------|-----------------| | 10,000 | Before | 4,119,668 | 2,546,460 | 61.81 | | 10,000 | After | 1,574,172 | 973,260 | 61.82 | | 100,000 | Before | 11,519,724 | 9,600,436 | 83.34 | | 100,000 | After | 11,516,716 | 9,597,428 | 83.33 |	6 years ago
Luke Imhoff	18e06d14f7	Indexer.CoinBalance.Fetcher tuple instead of map in buffers ... ```elixir test "memory" do CoinBalance.Supervisor.Case.start_supervised!(json_rpc_named_arguments: []) pid = Process.whereis(CoinBalance.Fetcher) Stream.repeatedly(fn -> %{address_hash: address_hash(), block_number: block_number()} end) |> Enum.take(100) |> CoinBalance.Fetcher.async_fetch_balances() Process.info(pid, :memory) |> elem(1) |> IO.inspect(label: "BEFORE GC") :erlang.garbage_collect(pid) Process.info(pid, :memory) |> elem(1) |> IO.inspect(label: "AFTER GC") end ``` | Balances | Garbage Collection | Map (bytes) | Tuple (bytes) | Tuple / Map (%) | |----------|--------------------|-------------|---------------|-----------------| | 1,000 | Before | 372,444 | 230,484 | 61.88 | | 1,000 | After | 142,924 | 88,636 | 62.02 | | 100,000 | Before | 11,519,724 | 9,600,436 | 83.34 | | 100,000 | After | 11,516,716 | 9,597,428 | 83.33 |	6 years ago
Luke Imhoff	f04ea541d0	Indexer.CoinBalance.Fetcher bytes and integer instead of string in ... buffers ```elixir test "memory" do CoinBalance.Supervisor.Case.start_supervised!(json_rpc_named_arguments: []) pid = Process.whereis(CoinBalance.Fetcher) Stream.repeatedly(fn -> %{address_hash: address_hash(), block_number: block_number()} end) |> Enum.take(100) |> CoinBalance.Fetcher.async_fetch_balances() Process.info(pid, :memory) |> elem(1) |> IO.inspect(label: "BEFORE GC") :erlang.garbage_collect(pid) Process.info(pid, :memory) |> elem(1) |> IO.inspect(label: "AFTER GC") end ``` | Balances | Garbage Collection | String (bytes) | Bytes and Integer (bytes) | Bytes / String (%) | |----------|--------------------|----------------|---------------------------|--------------------| | 100 | Before | 55,244 | 34,548 | 62.54 | | 100 | After | 21,764 | 13,860 | 63.68 | | 1,000 | Before | 601,972 | 372,444 | 61.87 | | 1,000 | After | 230,596 | 142,924 | 61.98 | | 10,000 | Before | 4,119,668 | 2,546,460 | 61.81 | | 10,000 | After | 1,574,172 | 973,260 | 61.83 | | 100,000 | Before | 16,586,644 | 11,519,724 | 69.45 | | 100,000 | After | 16,583,636 | 11,516,716 | 69.45 |	6 years ago
Luke Imhoff	77d32df7c2	Store exchange rates as tuples in ETS ... 2177 kB for {symbol, Token} vs 1864 kB for {symbol, ...} with each Token field in a separate element of the tuple.	6 years ago
Luke Imhoff	8d542f07bd	Buffer tuples instead of maps ... ```elixir test "memory" do TokenBalance.Supervisor.Case.start_supervised!(json_rpc_named_arguments: []) pid = Process.whereis(TokenBalance.Fetcher) 1_000 |> build_list(:token_balance) |> Enum.map(& %{&1 | address_hash: &1.address.hash, token_contract_address_hash: address_hash()}) |> TokenBalance.Fetcher.async_fetch() Process.info(pid, :memory) |> IO.inspect(label: "BEFORE GC") :erlang.garbage_collect(pid) Process.info(pid, :memory) |> IO.inspect(label: "AFTER GC") end ``` | Token Balances | Garbage Collection | Map (bytes) | Tuple (bytes) | Tuple / Map (%) | |----------------|--------------------|-------------|---------------|-----------------| | 1,000 | Before | 233,500 | 145,828 | 62.45 | | 1,000 | After | 230,492 | 142,820 | 61.96 | | 50,000 | Before | 8,001,028 | 6,668,188 | 83.34 | | 50,000 | After | 7,998,020 | 6,665,180 | 83.35 |	6 years ago
Luke Imhoff	b313af6d7f	Buffer hash bytes instead of hash strings ... ```elixir test "memory" do TokenBalance.Supervisor.Case.start_supervised!(json_rpc_named_arguments: []) pid = Process.whereis(TokenBalance.Fetcher) 10_000 |> insert_list(:token_balance) |> TokenBalance.Fetcher.async_fetch() Process.info(pid, :memory) |> IO.inspect(label: "BEFORE GC") :erlang.garbage_collect(pid) Process.info(pid, :memory) |> IO.inspect(label: "AFTER GC") end ``` | Token Balances | Garbage Collection | Hash Strings (bytes) | Hash Bytes (bytes) | Bytes / String (%) | |----------------|--------------------|----------------------|--------------------|--------------------| | 1,000 | Before | 233,500 | 233,500 | 100.00 | | 1,000 | After | 233,500 | 230,492 | 98.71 | | 10,000 | Before | 2,549,476 | 1,577,180 | 61.86 | | 10,000 | After | 2,546,468 | 1,574,172 | 61.82 |	6 years ago
Luke Imhoff	48b1de4617	Buffer formatted params instead of %TokenBalance{} ... ```elixir test "memory" do TokenBalance.Supervisor.Case.start_supervised!(json_rpc_named_arguments: []) pid = Process.whereis(TokenBalance.Fetcher) 10_000 |> insert_list(:token_balance) |> TokenBalance.Fetcher.async_fetch() Process.info(pid, :memory) |> IO.inspect(label: "BEFORE GC") :erlang.garbage_collect(pid) Process.info(pid, :memory) |> IO.inspect(label: "AFTER GC") end ``` | Token Balances | Garbage Collection | `%TokenBalance{}`s (bytes) | `%{token_contract_address_hash: Hash.to_string(token_contract_address_hash), address_hash: Hash.to_string(address_hash), block_number: block_number}` (bytes) | Map / Struct (%) | |----------------|--------------------|----------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------|------------------| | 1,000 | Before | 2,549,476 | 233,500 | 9.16 | | 1,000 | After | 2,546,468 | 233,500 | 9.17 | | 10,000 | Before | 19,903,172 | 2,549,476 | 12.81 | | 10,000 | After | 19,900,260 | 2,546,468 | 12.80 |	6 years ago
Luke Imhoff	753319de4a	Store ranges as tuples in Sequence :queue ... Found a memory savings for `Indexer.Sequence`: store Ranges as tuples in the `:queue` as the tuples take up less space than than the `%Range{}` struct, but only after garbage-collection. The incoming and outgoing format is still Ranges, so this is a non-breaking implementation detail only. ```elixir test "memory usage" do {:ok, pid} = Sequence.start_link(ranges: [max_block_number..0], step: -10) Process.info(pid, :memory) |> IO.inspect(label: "BEFORE GC") :erlang.garbage_collect(pid) Process.info(pid, :memory) |> IO.inspect(label: "AFTER GC") end ``` | max_block_number | Garbage Collection | Ranges (bytes) | Tuples (bytes) | Tuples / Ranges (%) | |------------------|--------------------|----------------|----------------|---------------------| | 5,000,000 | Before | 41,050,964 | 22,445,660 | 54.68 | | 5,000,000 | After | 34,386,756 | 23,879,996 | 69.45 | | 10,000,000 | Before | 80,889,772 | 47,928,116 | 59.24 | | 10,000,000 | After | 71,303,316 | 49,516,492 | 69.44 |	6 years ago
Ryan Arthur	184fa1e222	Fix text color in address balance	6 years ago
Ryan Arthur	4655cc8771	Edit Rinkeby logo	6 years ago
Ryan Arthur	432e1abf49	Edit DAI Chain logo	6 years ago
Lokraan	53561131b4	Merge branch 'master' into consolidate-validation-count	6 years ago
Lokraan	112fcf1aab	Run mix format, credo, gettext.extract --merge.	6 years ago
Lokraan	7a243de380	Fixed validation count bug on address page. ... address.js When the page loaded, the number of validations was being set to the number of transactions. remove logging in address.js	6 years ago
Lokraan	76fc8e0377	Store validation counts for each address in an ets table. ... Use `realtime` and `catchup` events to differentiate what the client and counter have to listen to. Store validation counts for each address in an ets table.	6 years ago
jimmay5469	88ab1172bc	JS cleanup ... Co-authored-by: Stamates <stamates@hotmail.com>	6 years ago
Stamates	1814f3ee76	I18n	6 years ago
Stamates	883886c047	Create placeholder for loading percentage and live update	6 years ago
Ryan Arthur	f6fc1ec62e	WIP add indexing alert message dummy element in the UI	6 years ago
Stamates	0e7ee4ee96	Calculate loading status triggered by catchup block event	6 years ago
Ryan Arthur	0462b65ed0	Formatting	6 years ago
Ryan Arthur	01b107c6f7	Internationalization	6 years ago
Ryan Arthur	306b0ff2e8	Fix the fixes	6 years ago
Ryan Arthur	0a4753dace	Fix dashboard chart legend colors	6 years ago
Ryan Arthur	a7dc7c1ce1	Make DAI logo bigger	6 years ago
Ryan Arthur	e241278e4a	UI fixes for all chains	6 years ago
Stamates	42388a9b1a	Remove more flaky tests	6 years ago
Stamates	522e6aace5	I18n	6 years ago
Stamates	5b8ec2324e	Improve coveralls coverage	6 years ago
Stamates	4642a646b9	Remove flaky tests that seem redundant	6 years ago
Stamates	8bb75e77a0	Fix text on Block Mined (includes I18n)	6 years ago
Stamates	3254ead1ee	Fill-in skipped blocks on page render for blocks list and homepage	6 years ago