hyperlane-monorepo

Commit Graph

Author	SHA1	Message	Date
Mattie Conover	a19ad5c08e	Serial-submitter rework (#1978 ) ### Description Updates the serial submitter to use a priority queue (heap) to sort messages by when they should next be retried and avoid sifting through the entire queue which has become increasingly large in some cases. This also improves logging around the message that is currently being processed. ### Drive-by changes - Refactored `SubmitMessageArgs` -> `PendingMessage` - Cleaned up documentation which had severely rotted ### Related issues - Fixes #1894 - Fixes #1955 - Blocked by #1973 ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ Manual Unit Tests	2 years ago
Nam Chu Hoai	27798e0e0a	Set origin of metric (#1981 ) ### Description The metric sets it for the origin label of `any` which is not as useful as setting to the actual origin	2 years ago
Mattie Conover	1c2eb1bc07	Scraper Refresh (#1932 ) ### Description Since we need to re-scrape everything anyway, wanted to go ahead and make some improvements and bug fixes now. * Adds code to scrape gas payments from the IGP during the sync loop * Updates gas payments table to work with new gas payment format * Fixed support with scraper for new configuration format (adds configurable list of chains to scrape) * Adds a new view for messages to display all relevant information * Adds a new view for gas payments to show total amounts paid for a given message * Fixed a bug introduced by seaorm (0.10) where `last_inserted_id` switched from being the first insert id to being the last * Pulled in a fix from @serejke in #1925 * Updated seaorm to 0.11.1 * Adds support for sepolia * Improved logging output at various levels ### Drive-by changes * Updated fallback provider to still retry even if it only has one url * Adds support for postgres `numeric` types to store Wei values (supported as of seaorm 0.11) * Switches to `bytea` representations of binary values * Switched from the `chrono` library to `time` (`chrono` is outdated and uses an unpatched version of `time`) * Removed redundant timestamp from `message` table * Cleans up some unused code ### Related issues - Fixes #1925 - Fixes #1156 ### Backward compatibility _Are these changes backward compatible?_ No - this has a new database format and for this reason defines entirely new migrations. _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ Yes - I changed it to `scraper3` so that we can run it along side the old scraper. It now also lines up with the name in the database. There is a new env var to specify what chains are scraped `HYP_BASE_CHAINSTOSCRAPE`. ### Testing _What kind of testing have these changes undergone?_ Manual - Been running the scraper locally and also deployed a current version of it to testnet3 for a subset of chains.	2 years ago
Mattie Conover	b25fe7f355	Change relayer backoff scaling (#1973 ) ### Description This adds more backoff to earlier requests so that a request which is sent when there are no others won't be retired constantly until it ends up in the 5min backoff phase. ### Drive-by changes None ### Related issues - Fixes #1896 ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ Unit Tests	2 years ago
Mattie Conover	92542e5d3e	Reduce external logging (#1974 ) ### Description Cuts out a few very verbose log targets that are not relevant for us at the debug level. Specifically `rusoto_core` and `reqwest` debug logs. ### Drive-by changes None ### Related issues - Mentioned in #1896 ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ Manual	2 years ago
Mattie Conover	4657fcc737	Better rust package management (#1975 ) ### Description At the suggestion of @tkporter this moves common dependencies and configuration to use the new(ish) cargo workspace configuration feature. This was added in July 2022 and allows us to ensure all versions and configurations are the same across different crates. It does not decrease the typing, but it does reduce the updates required when we go to update a package and keeps duplicates next to each other. This PR does not change any package versions or add/remove any packages. It only moves the configuration. ### Drive-by changes Also sorted packages by name. ### Related issues ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ Manual	2 years ago
Mattie Conover	8fcb458062	Indicate why metadata could not be fetched on debug (#1905 ) ### Description - Changes metadata failure reasons to be DEBUG level. - Adds generic failure message as INFO level - Adds context to all errors returned by the metadata constructor to make them easier to trace. ### Drive-by changes None ### Related issues - Relates to #1856 ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ Unit Tests	2 years ago
Nam Chu Hoai	9abce515a4	Reduce IGP indexer verbosity (#1965 ) ### Description Similar to the change we had to the mailbox to avoid polluting the logs	2 years ago
Nam Chu Hoai	4cda702a30	Require >30 gwei for Polygon (#1952 ) ### Description Fixes #1933. It's not pretty but I would like to sleep tonight	2 years ago
Trevor Porter	97a1d0f959	Change ethereum finality in config 14 -> 20 (#1959 ) ### Description See https://github.com/hyperlane-xyz/issues/issues/415 for context Essentially all validators are on 20 block finality but we changed the relayer to 14 [recently](https://github.com/hyperlane-xyz/hyperlane-monorepo/pull/1675/files#diff-67e27b51135e9801b172be277ee0f667ed7b5ea5cb600f987bceb03b75eb3d65R33). It results in a weird scenario where the relayer will retry a message a few times before there's a quorum from validators. Moving back to 20 in the relayer ### Drive-by changes * Added names to validator addresses which I found useful to know at a glance ### Related issues - Fixes https://github.com/hyperlane-xyz/issues/issues/415 ### Backward compatibility _Are these changes backward compatible?_ yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ Sorta. We should re-deploy agents from this commit ### Testing _What kind of testing have these changes undergone?_ None	2 years ago
Mattie Conover	52404d25a6	Better context to track down errors during init (#1911 ) ### Description - Additional context to error to track down what chain's configuration is invalid. ### Drive-by changes None ### Related issues - Fixes https://discord.com/channels/935678348330434570/961711527092682783/1082783165803937853 ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ Manual	2 years ago
Mattie Conover	1c004f4b10	Remove gelato support (#1946 ) ### Description We have not been using Gelato anymore so thought it would be nice to remove this code and avoid continuing to maintain it. I know I have had to update it a few times to maintain parity. As an added perk it should slightly speed up build times since it removes an entire crate. ### Drive-by changes None ### Related issues ### Backward compatibility _Are these changes backward compatible?_ Yes - As we do not use this code _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ Unit Tests	2 years ago
Trevor Porter	81ad2295fe	Move to estimateRetryableTicket to get L2 gas for arbitrum chains (#1949 ) ### Description * Moves to `estimateRetryableTicket` to get Arbitrum L2 gas ### Drive-by changes none ### Related issues - Fixes #1728 ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ Unit tests - haven't deployed yet tho	2 years ago
Mattie Conover	2c0b12528b	Support default signer configuration (#1908 ) ### Description - Adds a `defaultSigner` to settings which will automatically set all chains without their own signer configuration to use it. - Adds validation to relayers at startup to ensure that all destination chains have a signer configuration set. - Updates e2e test to validate this works ### Drive-by changes - Support `StrOrInt` or metric port deserialization. ### Related issues - Relates to #1856 ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ E2E Test	2 years ago
Sergei Patrikeev	d510a19546	fix: index the message with zero nonce. (#1925 ) ### Description Proposed fix of #1924 ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ Manual --------- Co-authored-by: Trevor Porter <trkporter@ucdavis.edu> Co-authored-by: Nam Chu Hoai <nambrot@googlemail.com>	2 years ago
Nam Chu Hoai	80005f01e9	Add Sepolia (#1930 ) ### Description This PR deploys Hyperlane to Sepolia. Updates packages to 1.2.2 to include sepolia ### Drive-by changes - Fixes ContractVerifier - Adds multiple bytecode hashes that are valid in HyperlaneCoreChecker ### Related issues - Fixes #1878 ### Backward compatibility Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None	2 years ago
Trevor Porter	7fb935e801	Arbitrum gas amount handling in gas enforcement policies (#1912 ) ### Description See #1728 for detailed explanation Uses Arbitrum's NodeInterface to get the L1 cost of a tx so we can isolate the L2 gas and use that for gas enforcement policies. Very open to alternative ideas in the way I wrote it as well ### Drive-by changes No ### Related issues - Fixes #1728 ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ Unit Tests - haven't deployed yet, but plan to deploy to rc testnet soon	2 years ago
Nam Chu Hoai	97c7f52801	Remove GasPaymentEnforcementPolicy::MeetsEstimatedCost (#1910 ) ### Description As discussed offline, to establish the social contract of the relayer accepting the quotes of its associated IGP on the origin chain, this PR removes the GasPaymentEnforcementPolicy that was assessing gas payments at tx submission time via off-chain oracles.	2 years ago
Mattie Conover	0049cca1ba	Support On Chain Fee Quoting (#1658 ) ### Description * New gas enforcement policy that uses the on-chain-fee-quoting values. * Change gas enforcement policies to return the gas limit that should be used to submit the transaction. * Change gelato submitter to use the gas limit provided by the gas enforcement policy. * Now indexes the gas amounts for the payments A couple of notes: * We might want to test this with the e2e test. * I took a look into the retying provider and it looks like it already does not retry on failed transaction submissions so I don't think anything needs to be done there after all. ### Drive-by changes ### Related issues - Fixes #1535 ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ Yes - changes the internal database format for message payments ### Testing _What kind of testing have these changes undergone?_ Unit Tests --------- Co-authored-by: Trevor Porter <trkporter@ucdavis.edu>	2 years ago
Trevor Porter	59a90b1bb6	Default to not allowing LocalStorage checkpoint syncers in relayer (#1900 ) ### Description Open to better names Adds a setting to the relayer, `allow_local_checkpoint_syncers`, which determines whether local storage based checkpoint syncers will be allowed by the metadata builder. Originally, I wanted something a bit more clever, like being able to specify `HYP_RELAYER_VALIDCHECKPOINTSYNCERS=LocalStorage,S3` or something, where I'd like those variants to be matched to the variants found in https://github.com/hyperlane-xyz/hyperlane-monorepo/blob/main/rust/hyperlane-base/src/types/checkpoint_syncer.rs#L14. But that enum requires values, so things get ugly. One option would be to create a new enum like: ``` enum CheckpointSyncerTypes { LocalStorage, S3, } ``` And another option is to use something like strum's [EnumString](https://docs.rs/strum/latest/strum/derive.EnumString.html) (shoutout to @mattiecnvr). But this still is a bit clunky, so for now just making this a bool and we can figure out something more elegant later if we ever get to a point where we're supporting multiple types of checkpoint syncers ### Drive-by changes none ### Related issues - Fixes https://github.com/hyperlane-xyz/issues/issues/402 ### Backward compatibility _Are these changes backward compatible?_ Yes - although if you ever want to run a relayer that uses local storage now, you'll need to set `HYP_RELAYER_ALLOWLOCALCHECKPOINTSYNCERS=true` _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None - we always expect to not be reading from the local fs in deployed relayers ### Testing _What kind of testing have these changes undergone?_ Ran e2e tests	2 years ago
Mattie Conover	599722a7ca	Load all configs by default (#1887 ) ### Description This removes `RUN_ENV` and `BASE_CONFIG` from the Rust config loading process and also from the helm charts and TS configs as appropriate. ### Drive-by changes - Flattens config dir structure - Removes the test config from the git repo. - Fixed a bug in the deploy script that caused the e2e pipeline to break when the config file was removed - Removes `environment` from the config files - Updates TS code to use `runEnv` for deployment - Updates TS code to type environment with `DeployEnvironment` instead of `string` ### Related issues - Relates to #1850 ### Backward compatibility _Are these changes backward compatible?_ Yes _Are there any infrastructure implications, e.g. changes that would prohibit deploying older commits using this infra tooling?_ None ### Testing _What kind of testing have these changes undergone?_ Manual - Updated e2e test to verify these don't cause a config loading issue.	2 years ago
Trevor Porter	f5d1fbbd03	On chain gas oracles in the IGP (#1765 ) * Rough implementations of all gas oracles, done with StaticGasOracle & tests * more tests, beef up StorageGasOracle * Tests cleaned up, moved to Foundry test for IGP * rm StaticGasOracle, fix all tests * cleaning up * comment * yarn gas, better comments * Fix sdk test * Fix e2e * Rm LZ stuff * fix router test * Rm MockInterchainGasPaymaster * pr comments * Move to setGasConfigs instead of setGasConfig * fix test * nit * yarn gas * IGP deploy & checker tooling, script to update on-chain StorageGasOracle data (#1794) * Add IGP gas oracle to checker * Checker works * Support different gas oracle contracts in IGP deploy tooling too * Export some types * Build out set-storage-gas-oracle-values * nit * nit * rm comment * Add pricing data * nits * nearly there * haven't tested e2e yet, but added new proxy upgrade logic to set gas oracles in IGP in upgradeAndCall * pr comments * lots * Move away from upgradeAndCall for IGP upgrade, trying to debug annoying dependency issue * Got working, cleaned a little * Add test to ensure a new implementation is deployed * yarn hyperlane * nits * cleaning * Map in description * Dedupe submission type logic * yarn gas * Separate beneficiary in IGP (#1801) * Add IGP gas oracle to checker * Checker works * Support different gas oracle contracts in IGP deploy tooling too * Export some types * Build out set-storage-gas-oracle-values * nit * nit * Add separate beneficiary to IGP * Checker / govern / deploy tooling * nits * Add compare-storage-gas-oracle * successful test upgrade, minor changes * Nits * Fix tests * Performed testne3 upgrade. Need to clean up code, but should probably use this for the mainnet upgrade * nit * update prices * Update gas prices and token exchange rates for mainnet * mainnet upgrade. needs lots of cleaning, but here it is in all its glory * Starting to clean up * more cleanup * Use updated submodules * yarn gas * nit * PR comments * yarn hyperlane * yarn gas	2 years ago
Trevor Porter	63db3ceeb8	Remove testnet3 relayer blacklist (#1890 ) Remove testnet3 blacklist	2 years ago
Mattie Conover	836179c9ad	Better default stack traces (#1886 ) * Update to use color-eyre by default for stack traces * Use backtrace setting to define config formatting for debugging	2 years ago
Mattie Conover	6ad3b39114	Allow configs to use number or strings for numerics (#1885 ) * Allow strings or integers for configuration * Update TS for new integer change * Fixed finality blocks parsing	2 years ago
Mattie Conover	7a121a8d80	Make relayer require destination chains (#1884 ) * Make destination chains required for relayers * Update helm chart to include destination chains * Added notice for missing destination chain names	2 years ago
Asa Oines	33a77c35e1	Submit txs with EIP 1559 in relayer (#1869 )	2 years ago
Asa Oines	653ddc82e7	Serialize concatenated signature (#1877 )	2 years ago
Mattie Conover	55242e65ce	Better errors for missing config values (#1814 ) * Better errors for missing config values * Cleanup * Added more help on missing name * Fix lints * fix format * fix format	2 years ago
Mattie Conover	03d32f4009	Eliminate trivial constructors (#1847 )	2 years ago
Mattie Conover	1b45f8cad1	Rust Updates (#1845 ) * Update rust lang version * Fix new clippy lint * Update packages * Update rocksdb * Updates	2 years ago
Asa Oines	0274c4f5ea	Better sanitization of announced validator locations (#1844 )	2 years ago
Mattie Conover	29f0c78f5e	Fix message logs (#1825 )	2 years ago
Asa Oines	207563b189	Add max message nonce gauge to relayer (#1819 )	2 years ago
Mattie Conover	8105913dea	Improve agent logging (#1797 )	2 years ago
Asa Oines	a836ce21d3	Use ValidatorAnnounce in relayer (#1569 )	2 years ago
Nam Chu Hoai	7b87e4a5de	Set latest_checkpoint instrumentation to debug level (#1785 )	2 years ago
Mattie Conover	4b7e7ca9bb	Improve config errors (#1776 ) * Remove path to error as it was not working * Better domain parsing errors * Locked min version of config lib * Improve error messages for config loading	2 years ago
Mattie Conover	d895cc29ca	Remove deprecated phase (#1761 )	2 years ago
Trevor Porter	b55d7c5516	Log gas enforcement configuration (#1770 ) * Log gas enforcement configuration * fmt	2 years ago
Trevor Porter	1f88d0dfa0	Add whitelist to gas enforcement, whitelist interchain queries (#1732 ) * Add gas payment whitelist to relayer * Add interchain query routers to the gas enforcement whitelist * update testnet3 rc image * don't really wanna mess with rc * nit comment * pr comments	2 years ago
Mattie Conover	aea71d7848	Add gnosis to scraper db (#1758 )	2 years ago
Trevor Porter	7daabfef35	Prevent calls to `Mailbox.recipientIsm` when the recipient of a message isn't a contract (#1763 ) * Add is_contract to avoid calls to recipientIsm when the recipient isn't a contract * trace -> debug	2 years ago
Mattie Conover	6a958f6956	Fallback testing (#1731 ) * Use httpFallback for rc * Update sha for rc * Add commit dates * Deploy RC * Deploy to testnet3 * Use fallback for testnet3	2 years ago
Mattie Conover	ce3e21fab4	Support relayers setting a maximum gas for transactions (#1670 ) * Add transaction gas limit for relayer * Don't run if it exceeds the limit * Allow skipping transaction gas limits for some chains * fmt * Update log * Update configs * Undo * disable max gas on main chains for now so we can test in rc first	2 years ago
Mattie Conover	d95d9b29db	v2 rc contexts (#1689 ) * Config for testnet3 * Config for mainnet2 * Removed newlines from debug print * Print full hashes for matching list debug * Deploy and config * Fixes from PR review * Fix compiler error * Deploy gnosis rc	2 years ago
Nam Chu Hoai	19dc142b1e	Deploy to Gnosis (#1675 ) * Gnosis deploy mainnet2 jan 26 * Fix rust * PR review * Set etheruem finality to 14 blocks * Fix testnet verification artifacts * fix artifact * Fix key funding logic * Deploy agents	2 years ago
Asa Oines	d9fb7beb71	Re-deploy ValidatorAnnounce contracts (#1676 )	2 years ago
Asa Oines	dabd490e06	Add domain separator to validator announcement (#1674 )	2 years ago
Mattie Conover	ba5f04a46b	Ported fix provider order (#1437 ) * Fix provider wrapping order (#1436) * Fix provider wrapping order * Better RPC provider metrics * Clean after cherry-pick * Cleanup	2 years ago

... 6 7 8 9 10 ...

907 Commits (b872d635e194e93b8813c207b557487ecd1a588a)