1248 Commits (6dbdb26b35a886265f154811373a18707c9a64ac)

Author	SHA1	Message	Date
Qwerty5Uiop	f8f6c78c7c	feat: Add memory metrics for OnDemand fetchers (#10425)	4 months ago
Qwerty5Uiop	314d2e7a5f	chore: Remove catchup sequence logic (#10415)	4 months ago
varasev	ad78a4d57a	Add Brotli decompression to Indexer.Fetcher.Optimism.TxnBatch (#10410) ... * Add Brotli decompression to Indexer.Fetcher.Optimism.TxnBatch * Update spelling --------- Co-authored-by: POA <33550681+poa@users.noreply.github.com>	4 months ago
varasev	c6ee4719ca	feat: Add Celestia blobs support to Optimism batches fetcher (#10199) ... * Initial Celestia blob metadata indexing * Add Celestia blob metadata to API v2 and indexing EIP-4844 blob hash * Add API endpoint returning L1 batch data by Celestia blob commitment and height * intermediate changes * Intermediate changes * Add Explorer.Chain.Optimism.FrameSequenceBlob entity * Add l1_batch field to API v2 output for a block * Add /txn-batch-by-celestia-blob/ to API v2 * Fix Indexer.Fetcher.Optimism.TxnBatch * Partially add specs and docs for public functions * Add some docs * Update spelling * Change routes for Optimism * Change response format * Change response format * Intermediate changes * Add /api/v2/optimism/batches endpoint * Clear code * Output exact number for /api/v2/optimism/games/count * Add /api/v2/optimism/batches/:internal_id endpoint * Add /api/v2/transactions/optimism-batch/:batch_number endpoint * Remove redundant OP env variables, use SystemConfig instead * Small fixes for dialyzer * Review improvements * Fix spelling * Minor fixes * mix format --------- Co-authored-by: POA <33550681+poa@users.noreply.github.com>	5 months ago
Alexander Kolotov	a8e483053e	fix: alternative way to detect blocks range for ArbitrumOne batches (#10295) ... * alternative way to detect rollup blocks range * code review comments addressed	5 months ago
Alexander Kolotov	3c268d2196	feat: AnyTrust and Celestia support as DA for Arbitrum batches (#10144) ... * Initial version of x-level messages indexer * fixes for cspell and credo * new state of x-level messages * Monitoring of new L1-to-L2 messages on L1 * new batches discovery * fetcher workers in separate modules * proper name * Fix for responses without "id", e.g. "Too Many Requests" * update DB with new batches and corresponding data * update DB with confirmed blocks * fixes for cspell and credo * tracking commitments confirmations for L1 to L2 messages * Proper usign of max function * tracking completion of L2 to L1 messages * catchup historical messages to L2 * incorrect version of committed file * catchup historical messages from L2 and completion of L1-to-L2 messages * historical batches catchup * status for historical l2-to-l1 messages * address matching issue * catchup historical executions of L2-to-L1 messages * db query to find unconfirmed blocks gaps * first changes to catchup historical confirmations * finalized catchup of historical confirmations * 4844 blobs support * fix for the issue with multiple confirmations * limit amount of batches to handle at once * Use latest L1 block by fetchers if start block is not configured * merge issue fix * missed file * historical messages discovery * reduce logs severity * first iteration to improve documentation for new functionality * second iteration to improve documentation for new functionality * third iteration to improve documentation for new functionality * fourth iteration to improve documentation for new functionality * fifth iteration to improve documentation for new functionality * final iteration to improve documentation for new functionality * Arbitrum related info in Transaction and Block views * Views to get info about batches and messages * usage of committed for batches instead of confirmed * merge issues addressed * merge issues addressed * code review issues addressed * code review issues addressed * fix merge issue * raising exception in the case of DB inconsistency * fix formatting issue * termination case for RollupMessagesCatchup * code review comments addressed * code review comments addressed * consistency in primary keys * dialyzer fix * code review comments addressed * missed doc comment * code review comments addressed * changes after merge * formatting issue fix * block and transaction views extended * updated indices creation as per code review comments * code review comment addressed * fix merge issue * configuration of intervals as time variables * TODO added to reflect improvement ability * database fields refactoring * association renaming * associations and fields in api response renamed * format issue addressed * feat: APIv2 endpoints for Arbitrum messages and batches (#9963) * Arbitrum related info in Transaction and Block views * Views to get info about batches and messages * usage of committed for batches instead of confirmed * merge issues addressed * changes after merge * formatting issue fix * code review comment addressed * associations and fields in api response renamed * format issue addressed * feat: Arbitrum-specific fields in the block and transaction API endpoints (#10067) * Arbitrum related info in Transaction and Block views * Views to get info about batches and messages * usage of committed for batches instead of confirmed * merge issues addressed * changes after merge * formatting issue fix * block and transaction views extended * code review comment addressed * associations and fields in api response renamed * format issue addressed * fix credo issue * fix tests issues * ethereumjsonrpc test fail investigation * test issues fixes * initial version to get DA infromation from batch transactions * merge issues fix * keep discovered da information in db * show the batch data source in API response * formatting, spelling and credo issues * Documentation and specs improved * covered a case with empty extra data * API endpoints updated * changed order of params for celestia * more robust string hash identification * duplcitated alias removed * missed field in the type documentation * mapset used instead of map * comments for unfolding results of getKeysetCreationBlock call * common function to get data key for Celestia blobs	5 months ago
Qwerty5Uiop	2a00b0cd1b	chore: Refactor init functions to use continue if needed (#10300)	5 months ago
Alexander Kolotov	b2345b159f	feat: broadcast updates about new Arbitrum batches and L1-L2 messages through WebSocket (#10272) ... * publish new batches through websockets * publish new L1-L2 messages amount through websockets * credo issues * Consitent handling of transaction hash * new types re-used	5 months ago
Alexander Kolotov	d6080e04a1	fix: proper handling for re-discovered Arbitrum batches (#10326) ... * extended types documentation * proper handling for re-discovered batches * specification added * Code review comment addressed	5 months ago
Alexander Kolotov	bd09249c17	fix: proper lookup of confirmed Arbitrum cross-chain messages (#10322) ... * extended types documentation * proper query for confirmed messages	5 months ago
Alexander Kolotov	e7fa979c15	fix: indexer first block usage to halt Arbitrum missed messages discovery (#10280)	5 months ago
Viktor Baranov	f1a8b7e1a9	6.7.2	5 months ago
Kirill Fedoseev	7fe5bb98de	chore: bump elixir to 1.16.3 and Erlang OTP to 26.2.5.1 (#9256) ... * feat: bump elixir to 1.16.0 * fix: failing tests * fix: one more test * fix: qemu arm build * fix: failing market test * fix: override version in ci * chore: bump to 1.16.1 * fix: ci config override * chore: bump to 1.16.3 * chore: mix format * fix: faulty explorer tests * fix: faulty block_scout_web tests * chore: lint * ci: remove arm build workaround * chore: fix negative slice warnings * Erlang 26.2.5.1 --------- Co-authored-by: Viktor Baranov <baranov.viktor.27@gmail.com>	5 months ago
Victor Baranov	18c0a61c34	Revert "chore(deps): bump logger_json from 5.1.4 to 6.0.3 (#10270)" (#10348) ... This reverts commit 1348636372.	5 months ago
dependabot[bot]	1348636372	chore(deps): bump logger_json from 5.1.4 to 6.0.3 (#10270) ... Bumps [logger_json](https://github.com/Nebo15/logger_json) from 5.1.4 to 6.0.3. - [Release notes](https://github.com/Nebo15/logger_json/releases) - [Commits](https://github.com/Nebo15/logger_json/compare/5.1.4...6.0.3) --- updated-dependencies: - dependency-name: logger_json dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>	5 months ago
nikitosing	dfba569dbe	6.7.1 (#10325)	5 months ago
Kirill Fedoseev	e187299e74	fix: set timeout in seconds (#10283)	5 months ago
Alexander Kolotov	9448ccb7c8	fix: proper hex-encoded transaction hash recognition in ZkSync batches status checker (#10255) ... * proper hex-encoded transaction hash recognition * mix format --------- Co-authored-by: Viktor Baranov <baranov.viktor.27@gmail.com>	5 months ago
Viktor Baranov	57293ec52d	6.7.0	5 months ago
Victor Baranov	4297704b8e	feat: API endpoint to re-fetch token instance metadata (#10097) ... * feat: Re-fetch token instance metadata * Partially process review comments * Process reviewer comments. Part 2 * Process reviewer comments. Part 3 * Process reviewer comments. Part 4 * Fix events * Add test * Remove :token preload * fix formatting * Fix tests * Remove unused aliases * Add reCAPTCHA for token instance re-fetch API endpoint * Check event on websocket at /api/v2/tokens/{address_hash}/instances/{token_id}/refetch-metadata endpoint	5 months ago
Alexander Kolotov	c31f937680	fix: batch transactions view recovered and support of proofs through ZkSync Hyperchain (#10234) ... * unified tx_hash field with Arbitrum batch transaction * Supported yet another contract function to submit batches proofs * fixed formatting issue	5 months ago
Victor Baranov	e29f3e2a52	feat: Get ERC-1155 token name from contractURI getter fallback (#10187) ... * Get ERC-1155 token name from contractURI getter fallback * Process review comments * Change doc and spec for stream_cataloged_tokens function	6 months ago
Qwerty5Uiop	653f91248b	feat: Push relevant entries to the front of bound queue (#10193) ... * feat: Push relevant entries to the front of bound queue * Refactor realtime? parameter in async_import_remaining_block_data	6 months ago
Alexander Kolotov	85a51007f2	fix: excessive logging for Arbitrum batches confirmations (#10205) ... * revisited logging to explore start block of confirmation range * improvement of logging	6 months ago
nikitosing	80a8e3b464	fix: Filter WETH transfers in indexer + migration to delete historical incorrect WETH transfers (#10134)	6 months ago
Qwerty5Uiop	646a343ba7	chore: Refactor PendingTransactionsSanitizer to use batched requests (#10101)	6 months ago
nikitosing	034bc181b7	fix: Fix Retry NFT fetcher (#10146)	6 months ago
Qwerty5Uiop	e2692945fc	feat: Add window between balance fetch retries for missing balanceOf tokens (#10142)	6 months ago
Victor Baranov	67a966833d	Explicit message on token balance update error (#10129)	6 months ago
varasev	dc44b18030	fix: Hotfix for Indexer.Fetcher.Optimism.WithdrawalEvent and EthereumJSONRPC.Receipt (#10130) ... * fix: Hotfix for Indexer.Fetcher.Optimism.WithdrawalEvent * Small refactoring * Small refactoring * Consider nil in game_index * Add empty handler for Optimism Fjord tx receipt fields --------- Co-authored-by: POA <33550681+poa@users.noreply.github.com>	6 months ago
Alexander Kolotov	35c885def5	feat: indexer for cross level messages on Arbitrum (#9312) ... * Initial version of x-level messages indexer * fixes for cspell and credo * new state of x-level messages * Monitoring of new L1-to-L2 messages on L1 * new batches discovery * fetcher workers in separate modules * proper name * Fix for responses without "id", e.g. "Too Many Requests" * update DB with new batches and corresponding data * update DB with confirmed blocks * fixes for cspell and credo * tracking commitments confirmations for L1 to L2 messages * Proper usign of max function * tracking completion of L2 to L1 messages * catchup historical messages to L2 * incorrect version of committed file * catchup historical messages from L2 and completion of L1-to-L2 messages * historical batches catchup * status for historical l2-to-l1 messages * address matching issue * catchup historical executions of L2-to-L1 messages * db query to find unconfirmed blocks gaps * first changes to catchup historical confirmations * finalized catchup of historical confirmations * 4844 blobs support * fix for the issue with multiple confirmations * limit amount of batches to handle at once * Use latest L1 block by fetchers if start block is not configured * merge issue fix * missed file * historical messages discovery * reduce logs severity * first iteration to improve documentation for new functionality * second iteration to improve documentation for new functionality * third iteration to improve documentation for new functionality * fourth iteration to improve documentation for new functionality * fifth iteration to improve documentation for new functionality * final iteration to improve documentation for new functionality * merge issues addressed * code review issues addressed * code review issues addressed * fix merge issue * raising exception in the case of DB inconsistency * fix formatting issue * termination case for RollupMessagesCatchup * code review comments addressed * code review comments addressed * consistency in primary keys * dialyzer fix * code review comments addressed * missed doc comment * code review comments addressed * updated indices creation as per code review comments * fix merge issue * configuration of intervals as time variables * TODO added to reflect improvement ability * database fields refactoring * association renaming * feat: APIv2 endpoints for Arbitrum messages and batches (#9963) * Arbitrum related info in Transaction and Block views * Views to get info about batches and messages * usage of committed for batches instead of confirmed * merge issues addressed * changes after merge * formatting issue fix * code review comment addressed * associations and fields in api response renamed * format issue addressed * feat: Arbitrum-specific fields in the block and transaction API endpoints (#10067) * Arbitrum related info in Transaction and Block views * Views to get info about batches and messages * usage of committed for batches instead of confirmed * merge issues addressed * changes after merge * formatting issue fix * block and transaction views extended * code review comment addressed * associations and fields in api response renamed * format issue addressed * fix credo issue * fix tests issues * ethereumjsonrpc test fail investigation * test issues fixes	6 months ago
Viktor Baranov	88394ff6fb	6.6.0	6 months ago
nikitosing	379e81afc2	feat: Add optional retry of NFT metadata fetch in Indexer.Fetcher.Tok… (#10036) ... * feat: Add optional retry of NFT metadata fetch in Indexer.Fetcher.TokenInstance.Realtime * Rename env * Process review comments * Rename var	6 months ago
nikitosing	64b55faea3	chore: Update hackney pool size: add new fetchers accounting (#9941)	6 months ago
nikitosing	2dd96493bd	feat: Improve retry NFT fetcher (#10027) ... * feat: Improve retry NFT fetcher * Process review comments * Fix spelling	6 months ago
varasev	3ecb5559c5	chore: Add support of Blast-specific L1 OP withdrawal events (#10049) ... * Add support of Blast-specific L1 OP withdrawal events * mix format --------- Co-authored-by: POA <33550681+poa@users.noreply.github.com>	7 months ago
Victor Baranov	de755d81ad	Show blocks range in internal transactions fetching error (#10028)	7 months ago
nikitosing	f1392fc6ad	fix: Don't put error to NFT metadata (#9940) ... * fix: Don't put error to NFT metadata * Remove unused Explorer.Helper.maybe_decode/1	7 months ago
Viktor Baranov	141a85a9f0	Fix typo	7 months ago
varasev	744bfdc8b6	fix: Handle DB unavailability by PolygonZkevm.TransactionBatch fetcher (#10031) ... Co-authored-by: POA <33550681+poa@users.noreply.github.com>	7 months ago
Victor Baranov	f5eb946ccf	feat: Detect EIP-1967 proxy pattern on unverified smart-contracts (#9864) ... * Detect EIP-1967 proxy even for not verified smart-contracts * put_verified_from_twin/2 function * Implement proxy implementation model * Fix test * Fix DB migration * Refactoring * Fix tests * Change schema to store implementation arrays * Refactoring * Update apps/explorer/lib/explorer/etherscan/contracts.ex Co-authored-by: nikitosing <32202610+nikitosing@users.noreply.github.com> * Process review comments * Fix call of Implementation.get_implementation_address_hash * Refactor save_implementation_data/5 to save_implementation_data/4 * Process review comment * Remove duplicate call of implementation_updated_at * Eliminate metadata_from_verified_bytecode_twin from save_implementation_data function * Fix formatting * Set non-nil smart-contract into Implementation.get_implementation_address_hash(...) * Simplify clauses in save_implementation_data/3 * Get implementation data in a single DB request * Fix tests * Set different proxy verification success message in case of single/plural implementations * Refactoring --------- Co-authored-by: nikitosing <32202610+nikitosing@users.noreply.github.com>	7 months ago
Qwerty5Uiop	4049b036cc	feat: Omit balanceOf requests for tokens that doesn't support it (#10018) ... * feat: Omit balanceOf requests for tokens that doesn't support it * Missing balanceOf token refactoring * Fix failed token balance error matching	7 months ago
Qwerty5Uiop	f2d7bd4df0	chore: Enhance indexer memory metrics (#9984)	7 months ago
Qwerty5Uiop	ba83000f82	fix: Set refetch_needed: false on block import (#9953)	7 months ago
Viktor Baranov	f48323a1c0	6.5.0	7 months ago
Victor Baranov	d7641a28f3	feat: Exit on provided invalid CHAIN_TYPE (#9904)	7 months ago
varasev	01fe4e5537	feat: Support Optimism Fault Proofs (#9892) ... * Add game_index field to op_withdrawal_events db table * Draft for dispute games indexer * Add extra data indexing into Indexer.Fetcher.Optimism.DisputeGame * Add game statuses fetching into Indexer.Fetcher.Optimism.DisputeGame * Almost final Indexer.Fetcher.Optimism.DisputeGame * Setting constant values in Indexer.Fetcher.Optimism.DisputeGame * Extend Optimism Withdrawal statuses * Add API for Optimism dispute games * Handle a case of non-existent game * Add specs and docs * DisputeGame fetcher waits infinitely until OptimismPortal is updated * Fix spelling * Small refactoring --------- Co-authored-by: POA <33550681+poa@users.noreply.github.com>	7 months ago
TechVest	279bbe4b7e	chore: fix some typos in comments (#9900) ... Signed-off-by: TechVest <techdashen@qq.com>	7 months ago
Qwerty5Uiop	4d0a02756d	fix: Expand memory only if it was shrunk (#9907)	7 months ago
Victor Baranov	9e64ff8d6e	IPFS gateway URL extra params (#9898) ... * IPFS gateway URL authentication params * Fix cspell * Fix explorer tests * Add IPFS gateway URL custom header support * Parse cataloged value of IPFS_GATEWAY_URL_PARAM_LOCATION * Update apps/indexer/lib/indexer/fetcher/token_instance/metadata_retriever.ex Co-authored-by: Qwerty5Uiop <105209995+Qwerty5Uiop@users.noreply.github.com> * Update apps/indexer/lib/indexer/fetcher/token_instance/metadata_retriever.ex Co-authored-by: Qwerty5Uiop <105209995+Qwerty5Uiop@users.noreply.github.com> * Process review comments * Return exit(:shutdown) --------- Co-authored-by: Qwerty5Uiop <105209995+Qwerty5Uiop@users.noreply.github.com>	7 months ago