703 Commits (203df396dd258a6b83cfb31cb06ddbaadab897bd)

Author	SHA1	Message	Date
Trevor Porter	0691b7b326	Gelato relayer scaffolding (#950) ... * Revive fwd_req_op. * Transform iter map into a for loop in relayer.rs. * cargo fmt * Plumb signer into GelatoSubmitter. * Provide inbox signer to GelatoSubmitter init. This might fail, in which case the relayer can't really do anything for that inbox if it is configured to use Gelato. In that case, bail!(..). Bailing requires that the boot/init boilerplate in the relayer handle errors, so plumb/wrap those all in Result<> return types and update accordingly. * Plumb deps up to ForwardRequestArgs construction. * Plumb actual target chain, and rename chain --> target_chain. * Use 0xEE for native token always. * Plumb outbox chain id * Plumb address of IVM on target chain * Just use zero bytes instead of todo! to satisfy clippy etc. * Plumb IVM BaseContract into GelatoSubmitter so that we can use it to encode calldata for IVM.process(). * cargo fmt again * How to marshal bytes. * Add interface for accessing inbox contract eth address * Plumb inbox address into the gelato submitter finally. * cargo fmt * Actually return the address instead of todo!()... * Actually build the byte array of calldata! * Better error msg to fit < 100c * defer introducing fwd_req_op until next PR * Handful of pre-review cleanups: - Only give GelatoSubmitter the inbox domain instead of the whole InboxContracts - Don't wrap http: reqwest::Client in an Arc. It's unnecessary and handled internally for you, and better to clone() so that cxn pool reused. - Shorter names from imports where noticed - stub op.run() impl - shorter submitter field names where appropriate - dont pass GelatoConf to GelatoSubmitter - get correct visibility in abigen'd build code (and allow no doc comments to satisfy clippy) * rename data to call_data * cargo fmt * Defer field name change for chain_id and target in FwdReqArgs * Cleanup of relayer.rs including more clear data validation and imoprt scoping. * cargo fmt * Improve (?) address handling for inbox and ivm. * for InboxValidatorManagerVariants::contract_address(), actually delegate to the Mock variant implementation's contract_address() call instead of over-eagerly returning None. * Stub impl of _contract_address in mockall mock! Inbox contract impl. * for Other variants, match arm does unimplemented!(), so we avoid having to wrap in an Option, making cleaner at call sites * Minimize namespace qualifications where possible for Address-like types * attempt to make the IVM contract_address() for abacus-ethereum impl parallel to inbox w/r/t types * Move abacus domain conversion out of gelato::Chain and into private helper in gelato_submitter * More logical ordering of GelatoSubmitter struct fields * cargo fmt * Drop extra comment, clarify log * Plumb sponsor address from configs into GelatoSubmitter. Interpreted as a source chain address. * cargo fmt --all * stop trying to wrap http client in an arc, it's counterproductive * Write Ok once instead of every line * formatting * Do not separate with empty line the inner attributes found in lib.rs post-abigen-buildscript-exec Otherwise cargo fmt finds a diff and presubmits halt. * spelling typo * Change GelatoSubmitter construction from new to helper in relayer.rs. Also use simpler construction for tokenizing the proof for merkle trees when generating the forward request args struct. Was needlessly convoluted before using default trait unnecessarily etc. Use writeln instead of write in abigen util since clippy complains otherwise. * Get ivm_base_contract from ABI string directly rather than plumbing. * pass GelatoConf by as_ref() which refs inner type rather than &Option<GelatoConf> * Drop unrelated comment in gelato/chains.rs, noted elsewhere * Revive fwd_req_op. * Transform iter map into a for loop in relayer.rs. * cargo fmt * Plumb signer into GelatoSubmitter. * Provide inbox signer to GelatoSubmitter init. This might fail, in which case the relayer can't really do anything for that inbox if it is configured to use Gelato. In that case, bail!(..). Bailing requires that the boot/init boilerplate in the relayer handle errors, so plumb/wrap those all in Result<> return types and update accordingly. * Plumb deps up to ForwardRequestArgs construction. * Plumb actual target chain, and rename chain --> target_chain. * Use 0xEE for native token always. * Plumb outbox chain id * Plumb address of IVM on target chain * Just use zero bytes instead of todo! to satisfy clippy etc. * Plumb IVM BaseContract into GelatoSubmitter so that we can use it to encode calldata for IVM.process(). * cargo fmt again * How to marshal bytes. * Add interface for accessing inbox contract eth address * Plumb inbox address into the gelato submitter finally. * cargo fmt * Actually return the address instead of todo!()... * Actually build the byte array of calldata! * Better error msg to fit < 100c * defer introducing fwd_req_op until next PR * Handful of pre-review cleanups: - Only give GelatoSubmitter the inbox domain instead of the whole InboxContracts - Don't wrap http: reqwest::Client in an Arc. It's unnecessary and handled internally for you, and better to clone() so that cxn pool reused. - Shorter names from imports where noticed - stub op.run() impl - shorter submitter field names where appropriate - dont pass GelatoConf to GelatoSubmitter - get correct visibility in abigen'd build code (and allow no doc comments to satisfy clippy) * rename data to call_data * cargo fmt * Defer field name change for chain_id and target in FwdReqArgs * Cleanup of relayer.rs including more clear data validation and imoprt scoping. * cargo fmt * Improve (?) address handling for inbox and ivm. * for InboxValidatorManagerVariants::contract_address(), actually delegate to the Mock variant implementation's contract_address() call instead of over-eagerly returning None. * Stub impl of _contract_address in mockall mock! Inbox contract impl. * for Other variants, match arm does unimplemented!(), so we avoid having to wrap in an Option, making cleaner at call sites * Minimize namespace qualifications where possible for Address-like types * attempt to make the IVM contract_address() for abacus-ethereum impl parallel to inbox w/r/t types * Move abacus domain conversion out of gelato::Chain and into private helper in gelato_submitter * More logical ordering of GelatoSubmitter struct fields * cargo fmt * Drop extra comment, clarify log * Plumb sponsor address from configs into GelatoSubmitter. Interpreted as a source chain address. * cargo fmt --all * stop trying to wrap http client in an arc, it's counterproductive * Write Ok once instead of every line * formatting * Do not separate with empty line the inner attributes found in lib.rs post-abigen-buildscript-exec Otherwise cargo fmt finds a diff and presubmits halt. * spelling typo * Change GelatoSubmitter construction from new to helper in relayer.rs. Also use simpler construction for tokenizing the proof for merkle trees when generating the forward request args struct. Was needlessly convoluted before using default trait unnecessarily etc. Use writeln instead of write in abigen util since clippy complains otherwise. * Get ivm_base_contract from ABI string directly rather than plumbing. * pass GelatoConf by as_ref() which refs inner type rather than &Option<GelatoConf> * Drop unrelated comment in gelato/chains.rs, noted elsewhere * Wrap Inbox::contract_address() result in an Option. * Don't over-zealously mark pub(crate) struct's members pub(crate). pub is good enough. * More natural iter map construction in Token byte packing for call_data on process. * More natural iter map construction in Token byte packing for call_data on process. * Restore fwd req op struct and fmt * rm unnecessary Results * add with_capacity * Make contract_address return Address, not Option<Address> * rm unimplemeneted * Rm address field of validator manager * Mid refactor of creating GelatoSubmitter * add inbox_gelato_chain * cleaning * Some shuffling around * some moving around * Finishing touches * Remove unnecessary type definition & some unused code Co-authored-by: webbhorn <webb.horn@gmail.com>	2 years ago
Trevor Porter	faaaca2fa1	Change indexing logs (#954)	2 years ago
Trevor Porter	ebb0652b8d	Some clarifying comments following the new retry queue heuristic (#948) ... * Change queue heuristic * Add a todo * rm comment change * Drain without collecting and don't recreate the wait_queue * Add comments, oops	2 years ago
Trevor Porter	933dee6f7f	Push failing messages to the back of the run queue (#933) ... * Change queue heuristic * Add a todo * rm comment change * Drain without collecting and don't recreate the wait_queue	2 years ago
Trevor Porter	2b99232d11	lower verbosity of log that's printed for already seen gas payments (#937)	2 years ago
Nam Chu Hoai	cdb2c4dd1f	Always use the full chunk size (#935) ... * Always use the full chunk size * Add full chunk use to interchain gas payment events	2 years ago
Nam Chu Hoai	95eb1c47e3	Add leaf index as a key on the log line (#929)	2 years ago
Mattie Conover	fb91d959e8	Metrics Docs (#826) ... * Better documentation of the core metrics * Fix error * Contract sync metrics docs * phrasing * Correct doc * Apply suggestions from code review Co-authored-by: Nam Chu Hoai <nambrot@googlemail.com> * correction * Remove todo for ticket * Updated data type docs Co-authored-by: Nam Chu Hoai <nambrot@googlemail.com>	2 years ago
Mattie Conover	e5a72eaba2	Relayer blacklists (#807) ... * blacklists * fix not_matches logic to be more understandable * WIP * standardize src/dst * move docs around * Add tests for matches	2 years ago
Trevor Porter	f24aa96a0c	Filter by outbox address (#820)	2 years ago
Nam Chu Hoai	f0e96ed9ad	Fix CI (#833)	2 years ago
Nam Chu Hoai	b4389935e3	Update Celo/Alfajores/Fuji finality blocks (#825)	2 years ago
Nam Chu Hoai	5c384cefa8	Increase Avalanche Finality Blocks (#824)	2 years ago
Nam Chu Hoai	22254610ff	Removes deprecated environments (#677) ... * Remove dev and testnet environments from rust and sdk config * Remove testnet configration from infra * Remove reference to dev environment * Comment out for now	2 years ago
Trevor Porter	cd3e1e7aab	Tests for new message indexing (#813) ... * tests * Clean up * fmt * smaller diff * Fix comment	2 years ago
webbhorn	a8d5d0bd56	Bring `domain_and_chain!` macro up to date, and add test coverage to keep it there (#812) ... Fixes #786 Adds arbitrum, bsc, and optimism and their domains to the `domain_and_chain!` macro, which will enable portions of our monitoring to properly identify traffic relating to this chains instead of filling with "unknown" today. Also introduces a unit test that searches for any json config files it can find, tries to parse them all, takes the union of all chain names and domain mappings it can see, and ensures certain internal consistency properties hold and that the `domain_and_chain!` macro is aware of them. It's possible that this could be eventually adapated for json configs living in `typescript/infra` instead of `rust` if we go that direction. My hope was just to avoid a situation where we forget to keep things synchronized again.	2 years ago
webbhorn	ae03a7343b	Fix broken test `contract_sync::outbox::test::handles_missing_rpc_messages`. (#811) ... Before this PR, the test will panic due to outbox syncer running in a concurrent tokio task after the test completes and invoking mocked functions without expectations set. The panic is also swallowed by a separate bug and is only visible if tests are run under `cargo test -- --show-output`. After this PR, we no longer see a backtrace / panic when running with `cargo test -- --show-output`. We also correctly mark the test as failed in `cargo test` if we introduce a new panic in the test or DB harness code. Some additional changes to try and improve things adjacent to this test: * use tmpfs instead of disk + panic-unwind-detection for the RocksDB contents to avoid the panic detection complexity * avoid the current correctness dependency on sleep(from_secs(5)) in the test. This is inherently racy and it is not much harder or more complex to just select() with a timeout	2 years ago
Trevor Porter	90287d8738	Refactor message indexing to fix finding_message mode (#797) ... * Refactor message indexing to not have bugs * Nits * cargo fmt * Address comments	2 years ago
Mattie Conover	aa73b93f38	make timeout longer for contract deploy (#802)	2 years ago
webbhorn	e07a684924	Drop vestigial refernces to the optics project. (#800)	2 years ago
exdx	57bd7ab3e2	docs: Fix typo in validator.rs (#775)	2 years ago
Trevor Porter	856dde4802	Set reorgPeriod / finalityBlocks for arbitrum and optimism to 0 for testnet2 and mainnet (#778) ... * Set reorgPeriod / finalityBlocks for arbitrum and optimism for testnet2 and mainnet * More changes	2 years ago
Trevor Porter	75b116cd56	Add "contexts" to infrastructure tooling, this time with no circular dependency (#770) ... * Add contexts * Make validator configs and relayer configs optional * Introduce contexts * Get rid of coreConfig.agent, replace with coreConfig.agents * fix lint * Deployed, just needs some work with RPC urls * Add missing label in rust, disable undesired inboxes * Correctly disable chains, lol * Nit, rename chainNames to contextChainNames * nits * Fix getValidatorKeys * AWS flowcarbon testnet2; don't use default context * Better error when context is undefined * Add relayer funder cronjob context * Update flowcarbon testnet2 img * Fix helm parsing * whitelist * Make Contexts enum higher up * Make CheckpointSyncerType const * Move assertContext to avoid import cycle	2 years ago
webbhorn	401b6e2de9	run-locally: Run 'yarn prettier' after hardhat. (#750) ... Currently the process of starting/running our local hardhat setup results in an annoying irrelevant diff created against a test.json config file. The diff is due to lack of a file-terminating newline character. A better version of this change would probably fix the typescript script that touches / generates that file, but I'm completely unfamiliar with that setup (and TS in general) so opting for this hack for now.	2 years ago
webbhorn	274efcd34d	Restore reverted PR to .gitignore run-locally-induced diffs. (#746) ... This reverts commit 023eacd44b. Also introduce two minor changes: * End rust/.gitignore with a newline. * End test.json with newline, otherwise run-locally removes it, introducing an annoying diff.	2 years ago
Trevor Porter	84400b15c7	Revert "Add "contexts" to infrastructure tooling (#683)" (#741) ... This reverts commit e4a2811176. Co-authored-by: Mattie Conover <git@mconover.dev>	2 years ago
webbhorn	c819982db4	Reduce log severity for already-sent messages. (#735) ... It is expected for the 'processor' module to churn through the entire history of sent messages on relayer init, and it is expected/normal behavior to discover that the vast majority of those have already been sent. Therefore, it is cluttering / inappropriate to log those events at info! severity, and instead preferable to record them at debug severity. Co-authored-by: Mattie Conover <git@mconover.dev>	2 years ago
Trevor Porter	e4a2811176	Add "contexts" to infrastructure tooling (#683) ... * Add contexts * Make validator configs and relayer configs optional * Introduce contexts * Get rid of coreConfig.agent, replace with coreConfig.agents * fix lint * Deployed, just needs some work with RPC urls * Add missing label in rust, disable undesired inboxes * Correctly disable chains, lol * Nit, rename chainNames to contextChainNames * nits * Fix getValidatorKeys * AWS flowcarbon testnet2; don't use default context * Better error when context is undefined * Add relayer funder cronjob context * Update flowcarbon testnet2 img * Fix helm parsing * whitelist * Make Contexts enum higher up * Make CheckpointSyncerType const	2 years ago
Mattie Conover	f1357469a1	reduce "indexed block heights" log level (#719)	2 years ago
Trevor Porter	bf0b5b9a47	Re-add abacus/context label (#716)	2 years ago
webbhorn	87400211a5	Check delivery status on inbox before attempting delivery (#712) ... Restores functionality accidentally lost in #637 wherein we proactively check inbox message_status() call before attempting delivery of a message. * Check whether message has already been delivered before attempting delivery * s/deliver/process	2 years ago
Mattie Conover	8d0509a4d2	Operational cleanup (#707) ... * Reduce log level for common message * retry more of the errors and downgrade log level for non-stop cases * cleanup * reduce error logs	2 years ago
Mattie Conover	ef1ec1c24e	Update metric labels (#697)	2 years ago
webbhorn	8b79a14b51	Set message_delivered phase correctly in serial_submitter (#695) ... Update two metrics upon successful delivery of message: * counter reflecting number of messages successfully delivered during process lifetime * gauge of highest leaf index of any message delivered to this inbox so far during process lifetime Also updates run-locally integration test to verify these metric values upon test termination.	2 years ago
J M Rossy	80ffce0e3a	Fix path to SDK consts in infra core deploy script (#690) ... * Update working dirs for yarn ops * Fix path to SDK consts dir * Run test deploy * Update db path from cargo run-locally * Run prettier * Add outbox addr to kathy log * Fix rust fmt lint Co-authored-by: Mattie Conover <git@mconover.dev>	2 years ago
Mattie Conover	023eacd44b	Revert "stop checking in test configs since they are generated automatically (#685)" (#687) ... This reverts commit 5ec2d82740.	2 years ago
Mattie Conover	5ec2d82740	stop checking in test configs since they are generated automatically (#685)	2 years ago
Mattie Conover	0644e4b22d	E2E testing workflow (#679) ... * Work on new e2e script * new e2e mimics old * Support CI mode * Kathy CI mode * remove old script * e2e workflow * Update readme * fix workflow * split build from run * change build target * Use lighter-weight http client * fix typo * better handling for stopping children * Fix url * Support multiple filters * cache node modules * cache yarn build * ci cleanup * Cleanup and updates * requested changes	2 years ago
webbhorn	dd63f70da1	Gelato Plumbing (#637) ... This PR prepares for the introduction of Gelato ForwardRequest API usage. However, it only refactors current code and introduces a prerequisite interface. In particular, the existing MessageProcessor was previously responsible both for message discovery via AbacusDB, as well as managing the submission of that message to the destination chain via some RPC provider. Since we want to have the option to deliver those messages over Gelato, a natural place to split things up might be between the AbacusDB message discovery phase, and the message delivery phase. This CL formalizes that notion by moving the submission logic into a SerialSubmitter submodule. The MessageProcessor and SerialSubmitter only communicate via a channel now. A subsequent PR will introduce GelatoSubmitter, which will route messages from the MessageProcessor to the Gelato API according to the new configuration options introduced in this PR.	2 years ago
Trevor Porter	954d4bc866	Remote checkpointer infra (#673) ... * Remote checkpointer infra * rm more values * fix	2 years ago
Nam Chu Hoai	c80426383c	Only pass non-zero reorg periods as lag to latest_checkpoint (#676)	2 years ago
Trevor Porter	38cdae0f22	Some more correct finality numbers (#671) ... * More correct finality numbers * change all configs	2 years ago
Trevor Porter	ba8cdd04e0	Add destination domain to InterchainGasPaymaster.payGasFor (#668) ... * Add _destinationDomain param to payGasFor * update abis * Better comment Co-authored-by: Yorke Rhodes <yorke@useabacus.network>	2 years ago
Yorke Rhodes	ed99b22316	Add `InterchainGasPaymaster` back to APIs (#663) ... * Revert typescript changes from #558 * Add 0x0 addresses for IGP to environment artifacts * Update test addresses with IGP * Require explicit Router external initialize * Improve connection client SDK tools * Make IGP upgradeable and proxy in core deploy	2 years ago
Mattie Conover	3064991639	Better Retrying provider (#654) ... * WIP * Update retrying provider to only retry on connection issues * use better base retry time logic * cleanup * don't retry serialization errors * simplify logs * better error messages * Update loop logic * fix lint	2 years ago
Mattie Conover	02f32b61d0	Use current index for validator latest processed gauge init (#646)	2 years ago
Mattie Conover	de20710466	Rust updates (#644) ... * Update config and trim down macro code * Update rust * Package updates * Updates and cleanup * make clippy happy	2 years ago
Mattie Conover	fbf7130313	Provider request reduction (#638) ... * add contract function from call data to metric and no longer use histogram * fix warning * Get function names for metrics * Fix relayer metrics fetch interval * Fix validator metrics updates * initialize the latest processed checkpoint * Fix clippy errors	2 years ago
Mattie Conover	a7a14f3156	Fix configs (#639) ... * fix configs * print outbox addr * print outbox addr * Have deterministic contract addresses for deployments * Fix prettier * Write to rust config folder directly * Revert "print outbox addr" This reverts commit f4a6385079. * Revert "print outbox addr" This reverts commit ad9e5fb587. Co-authored-by: nambrot <nambrot@googlemail.com>	2 years ago
Nam Chu Hoai	8c9c38918e	Do not create inbox contracts if validator agent (#635)	2 years ago