530 Commits (d3886ed4aa7604149f18bb369c698e99723f0ec5)

Author	SHA1	Message	Date
Mattie Conover	f19110f4de	Quorum metrics (#1039) ... * Refactor ethers-prometheus in preparation * Rename metrics struct * Add JsonRpcMetrics wrapper * Plumbing new metrics in * Rename label for clarity	2 years ago
Mattie Conover	44361545f8	Message explorer entities (#998) ... * Make domain id the primary key * Generation code to build entities * generated entity code * update docs * Switch to hex strings for hashes and addresses * fix log config * Switch to varchar(64) * Fix stdio -> stderr	2 years ago
Mattie Conover	1a7e74ea7c	Update ethers (#1037)	2 years ago
Trevor Porter	2d9f729ac9	Process messages via Gelato ForwardRequests without charging gas yet (#967) ... * WIP, messy, just wanna test * Rename gelato_conf to gelato * Enabled is a str, not a bool * testing * working at least * closer * log * Things working pretty well * Cargo fmt * metrics * cleanin * cleaning * clippy * nit * deploy tooling * Fix disabled logic * Instrument * nits * More sane gelato config * nit * Reset rc * PR comment * Add ForwardRequestOpArgs * Add some chains to Gelato * Use Http * Fix test	2 years ago
Trevor Porter	000b67cf16	Upgrade ethers-rs to fix Optimsim gas estimation (#1023)	2 years ago
Nam Chu Hoai	03ebda6acd	Monitor validator checkpoints in CheckpointSyncer (#993) ... * Monitor validator checkpoints in CheckpointSyncer * PR review	2 years ago
Trevor Porter	09ef472844	Fix e2e (#1021)	2 years ago
Trevor Porter	893d8efc46	QuorumProvider testing in RC (#1018) ... * Update Cargo.lock * wip * Cleanup * Deploy to all chains * Fix build, still only write http connectionType in config * Use QuorumProvider for the outbox too * Use newer img	2 years ago
Trevor Porter	3e60d9aa29	Update Cargo.lock (#1007)	2 years ago
Mattie Conover	d316ae68d5	update ethers-rs (#1004)	2 years ago
Mattie Conover	0f5e319d11	Make domain id the primary key (#997) ... * Make domain id the primary key * Comment	2 years ago
Mattie Conover	5b06d0280c	Scraper DB generation and schema (#991) ... * Cleanup cargo config * BaseAgent trait * Pull `run_all` fn out of BaseAgent into static fn * Add `run` to `BaseAgent` * Scraper crate init * Create tables * WIP * data init * Init script * Fix * Attempting to run migration * fix ordering * fix domain creation * fix block table creation * fix checkpoint table * fix table cursor * fix table transaction + cleanup * enum type * progress * gas payments * message * delivered message * message state * cleanup * cleanup warnings * undo * Unique by domain and height * update index names * Change to OriginTxId * Add timestamp to messages * comment	2 years ago
webbhorn	02f9589fdc	Drop rust-Kathy (#713)	2 years ago
Asa Oines	ae5db869a5	Fix lint-rs (#989)	2 years ago
Mattie Conover	333b18ecfe	Quorum provider (#934) ... * Add quorum provider support * Update Rust * Pull Http logic out of retrying provider * first pass at retrying provider for quorum provider * change weight parsing * Better logging and handling for quorum retry logic * Better logging * Appease new clippy rules * Update packages in vein attempt to make things work * quorum provider testing * switch to our version of ethers-rs * Update config * Support quorum provider * Use quorum provider for testing * Update packages * Update	2 years ago
Mattie Conover	7be7183068	Mattie/message explorer/refactoring (#974) ... * Cleanup cargo config * BaseAgent trait * Pull `run_all` fn out of BaseAgent into static fn * Add `run` to `BaseAgent` * Fix merge	2 years ago
Nam Chu Hoai	805942e034	Add a 60s timeout to http requests (#973)	2 years ago
Trevor Porter	0691b7b326	Gelato relayer scaffolding (#950) ... * Revive fwd_req_op. * Transform iter map into a for loop in relayer.rs. * cargo fmt * Plumb signer into GelatoSubmitter. * Provide inbox signer to GelatoSubmitter init. This might fail, in which case the relayer can't really do anything for that inbox if it is configured to use Gelato. In that case, bail!(..). Bailing requires that the boot/init boilerplate in the relayer handle errors, so plumb/wrap those all in Result<> return types and update accordingly. * Plumb deps up to ForwardRequestArgs construction. * Plumb actual target chain, and rename chain --> target_chain. * Use 0xEE for native token always. * Plumb outbox chain id * Plumb address of IVM on target chain * Just use zero bytes instead of todo! to satisfy clippy etc. * Plumb IVM BaseContract into GelatoSubmitter so that we can use it to encode calldata for IVM.process(). * cargo fmt again * How to marshal bytes. * Add interface for accessing inbox contract eth address * Plumb inbox address into the gelato submitter finally. * cargo fmt * Actually return the address instead of todo!()... * Actually build the byte array of calldata! * Better error msg to fit < 100c * defer introducing fwd_req_op until next PR * Handful of pre-review cleanups: - Only give GelatoSubmitter the inbox domain instead of the whole InboxContracts - Don't wrap http: reqwest::Client in an Arc. It's unnecessary and handled internally for you, and better to clone() so that cxn pool reused. - Shorter names from imports where noticed - stub op.run() impl - shorter submitter field names where appropriate - dont pass GelatoConf to GelatoSubmitter - get correct visibility in abigen'd build code (and allow no doc comments to satisfy clippy) * rename data to call_data * cargo fmt * Defer field name change for chain_id and target in FwdReqArgs * Cleanup of relayer.rs including more clear data validation and imoprt scoping. * cargo fmt * Improve (?) address handling for inbox and ivm. * for InboxValidatorManagerVariants::contract_address(), actually delegate to the Mock variant implementation's contract_address() call instead of over-eagerly returning None. * Stub impl of _contract_address in mockall mock! Inbox contract impl. * for Other variants, match arm does unimplemented!(), so we avoid having to wrap in an Option, making cleaner at call sites * Minimize namespace qualifications where possible for Address-like types * attempt to make the IVM contract_address() for abacus-ethereum impl parallel to inbox w/r/t types * Move abacus domain conversion out of gelato::Chain and into private helper in gelato_submitter * More logical ordering of GelatoSubmitter struct fields * cargo fmt * Drop extra comment, clarify log * Plumb sponsor address from configs into GelatoSubmitter. Interpreted as a source chain address. * cargo fmt --all * stop trying to wrap http client in an arc, it's counterproductive * Write Ok once instead of every line * formatting * Do not separate with empty line the inner attributes found in lib.rs post-abigen-buildscript-exec Otherwise cargo fmt finds a diff and presubmits halt. * spelling typo * Change GelatoSubmitter construction from new to helper in relayer.rs. Also use simpler construction for tokenizing the proof for merkle trees when generating the forward request args struct. Was needlessly convoluted before using default trait unnecessarily etc. Use writeln instead of write in abigen util since clippy complains otherwise. * Get ivm_base_contract from ABI string directly rather than plumbing. * pass GelatoConf by as_ref() which refs inner type rather than &Option<GelatoConf> * Drop unrelated comment in gelato/chains.rs, noted elsewhere * Revive fwd_req_op. * Transform iter map into a for loop in relayer.rs. * cargo fmt * Plumb signer into GelatoSubmitter. * Provide inbox signer to GelatoSubmitter init. This might fail, in which case the relayer can't really do anything for that inbox if it is configured to use Gelato. In that case, bail!(..). Bailing requires that the boot/init boilerplate in the relayer handle errors, so plumb/wrap those all in Result<> return types and update accordingly. * Plumb deps up to ForwardRequestArgs construction. * Plumb actual target chain, and rename chain --> target_chain. * Use 0xEE for native token always. * Plumb outbox chain id * Plumb address of IVM on target chain * Just use zero bytes instead of todo! to satisfy clippy etc. * Plumb IVM BaseContract into GelatoSubmitter so that we can use it to encode calldata for IVM.process(). * cargo fmt again * How to marshal bytes. * Add interface for accessing inbox contract eth address * Plumb inbox address into the gelato submitter finally. * cargo fmt * Actually return the address instead of todo!()... * Actually build the byte array of calldata! * Better error msg to fit < 100c * defer introducing fwd_req_op until next PR * Handful of pre-review cleanups: - Only give GelatoSubmitter the inbox domain instead of the whole InboxContracts - Don't wrap http: reqwest::Client in an Arc. It's unnecessary and handled internally for you, and better to clone() so that cxn pool reused. - Shorter names from imports where noticed - stub op.run() impl - shorter submitter field names where appropriate - dont pass GelatoConf to GelatoSubmitter - get correct visibility in abigen'd build code (and allow no doc comments to satisfy clippy) * rename data to call_data * cargo fmt * Defer field name change for chain_id and target in FwdReqArgs * Cleanup of relayer.rs including more clear data validation and imoprt scoping. * cargo fmt * Improve (?) address handling for inbox and ivm. * for InboxValidatorManagerVariants::contract_address(), actually delegate to the Mock variant implementation's contract_address() call instead of over-eagerly returning None. * Stub impl of _contract_address in mockall mock! Inbox contract impl. * for Other variants, match arm does unimplemented!(), so we avoid having to wrap in an Option, making cleaner at call sites * Minimize namespace qualifications where possible for Address-like types * attempt to make the IVM contract_address() for abacus-ethereum impl parallel to inbox w/r/t types * Move abacus domain conversion out of gelato::Chain and into private helper in gelato_submitter * More logical ordering of GelatoSubmitter struct fields * cargo fmt * Drop extra comment, clarify log * Plumb sponsor address from configs into GelatoSubmitter. Interpreted as a source chain address. * cargo fmt --all * stop trying to wrap http client in an arc, it's counterproductive * Write Ok once instead of every line * formatting * Do not separate with empty line the inner attributes found in lib.rs post-abigen-buildscript-exec Otherwise cargo fmt finds a diff and presubmits halt. * spelling typo * Change GelatoSubmitter construction from new to helper in relayer.rs. Also use simpler construction for tokenizing the proof for merkle trees when generating the forward request args struct. Was needlessly convoluted before using default trait unnecessarily etc. Use writeln instead of write in abigen util since clippy complains otherwise. * Get ivm_base_contract from ABI string directly rather than plumbing. * pass GelatoConf by as_ref() which refs inner type rather than &Option<GelatoConf> * Drop unrelated comment in gelato/chains.rs, noted elsewhere * Wrap Inbox::contract_address() result in an Option. * Don't over-zealously mark pub(crate) struct's members pub(crate). pub is good enough. * More natural iter map construction in Token byte packing for call_data on process. * More natural iter map construction in Token byte packing for call_data on process. * Restore fwd req op struct and fmt * rm unnecessary Results * add with_capacity * Make contract_address return Address, not Option<Address> * rm unimplemeneted * Rm address field of validator manager * Mid refactor of creating GelatoSubmitter * add inbox_gelato_chain * cleaning * Some shuffling around * some moving around * Finishing touches * Remove unnecessary type definition & some unused code Co-authored-by: webbhorn <webb.horn@gmail.com>	2 years ago
Trevor Porter	faaaca2fa1	Change indexing logs (#954)	2 years ago
Trevor Porter	ebb0652b8d	Some clarifying comments following the new retry queue heuristic (#948) ... * Change queue heuristic * Add a todo * rm comment change * Drain without collecting and don't recreate the wait_queue * Add comments, oops	2 years ago
Trevor Porter	933dee6f7f	Push failing messages to the back of the run queue (#933) ... * Change queue heuristic * Add a todo * rm comment change * Drain without collecting and don't recreate the wait_queue	2 years ago
Trevor Porter	2b99232d11	lower verbosity of log that's printed for already seen gas payments (#937)	2 years ago
Nam Chu Hoai	cdb2c4dd1f	Always use the full chunk size (#935) ... * Always use the full chunk size * Add full chunk use to interchain gas payment events	2 years ago
Nam Chu Hoai	95eb1c47e3	Add leaf index as a key on the log line (#929)	2 years ago
Mattie Conover	fb91d959e8	Metrics Docs (#826) ... * Better documentation of the core metrics * Fix error * Contract sync metrics docs * phrasing * Correct doc * Apply suggestions from code review Co-authored-by: Nam Chu Hoai <nambrot@googlemail.com> * correction * Remove todo for ticket * Updated data type docs Co-authored-by: Nam Chu Hoai <nambrot@googlemail.com>	2 years ago
Mattie Conover	e5a72eaba2	Relayer blacklists (#807) ... * blacklists * fix not_matches logic to be more understandable * WIP * standardize src/dst * move docs around * Add tests for matches	2 years ago
Trevor Porter	f24aa96a0c	Filter by outbox address (#820)	2 years ago
Nam Chu Hoai	f0e96ed9ad	Fix CI (#833)	2 years ago
Nam Chu Hoai	b4389935e3	Update Celo/Alfajores/Fuji finality blocks (#825)	2 years ago
Nam Chu Hoai	5c384cefa8	Increase Avalanche Finality Blocks (#824)	2 years ago
Nam Chu Hoai	22254610ff	Removes deprecated environments (#677) ... * Remove dev and testnet environments from rust and sdk config * Remove testnet configration from infra * Remove reference to dev environment * Comment out for now	2 years ago
Trevor Porter	cd3e1e7aab	Tests for new message indexing (#813) ... * tests * Clean up * fmt * smaller diff * Fix comment	2 years ago
webbhorn	a8d5d0bd56	Bring `domain_and_chain!` macro up to date, and add test coverage to keep it there (#812) ... Fixes #786 Adds arbitrum, bsc, and optimism and their domains to the `domain_and_chain!` macro, which will enable portions of our monitoring to properly identify traffic relating to this chains instead of filling with "unknown" today. Also introduces a unit test that searches for any json config files it can find, tries to parse them all, takes the union of all chain names and domain mappings it can see, and ensures certain internal consistency properties hold and that the `domain_and_chain!` macro is aware of them. It's possible that this could be eventually adapated for json configs living in `typescript/infra` instead of `rust` if we go that direction. My hope was just to avoid a situation where we forget to keep things synchronized again.	2 years ago
webbhorn	ae03a7343b	Fix broken test `contract_sync::outbox::test::handles_missing_rpc_messages`. (#811) ... Before this PR, the test will panic due to outbox syncer running in a concurrent tokio task after the test completes and invoking mocked functions without expectations set. The panic is also swallowed by a separate bug and is only visible if tests are run under `cargo test -- --show-output`. After this PR, we no longer see a backtrace / panic when running with `cargo test -- --show-output`. We also correctly mark the test as failed in `cargo test` if we introduce a new panic in the test or DB harness code. Some additional changes to try and improve things adjacent to this test: * use tmpfs instead of disk + panic-unwind-detection for the RocksDB contents to avoid the panic detection complexity * avoid the current correctness dependency on sleep(from_secs(5)) in the test. This is inherently racy and it is not much harder or more complex to just select() with a timeout	2 years ago
Trevor Porter	90287d8738	Refactor message indexing to fix finding_message mode (#797) ... * Refactor message indexing to not have bugs * Nits * cargo fmt * Address comments	2 years ago
Mattie Conover	aa73b93f38	make timeout longer for contract deploy (#802)	2 years ago
webbhorn	e07a684924	Drop vestigial refernces to the optics project. (#800)	2 years ago
exdx	57bd7ab3e2	docs: Fix typo in validator.rs (#775)	2 years ago
Trevor Porter	856dde4802	Set reorgPeriod / finalityBlocks for arbitrum and optimism to 0 for testnet2 and mainnet (#778) ... * Set reorgPeriod / finalityBlocks for arbitrum and optimism for testnet2 and mainnet * More changes	2 years ago
Trevor Porter	75b116cd56	Add "contexts" to infrastructure tooling, this time with no circular dependency (#770) ... * Add contexts * Make validator configs and relayer configs optional * Introduce contexts * Get rid of coreConfig.agent, replace with coreConfig.agents * fix lint * Deployed, just needs some work with RPC urls * Add missing label in rust, disable undesired inboxes * Correctly disable chains, lol * Nit, rename chainNames to contextChainNames * nits * Fix getValidatorKeys * AWS flowcarbon testnet2; don't use default context * Better error when context is undefined * Add relayer funder cronjob context * Update flowcarbon testnet2 img * Fix helm parsing * whitelist * Make Contexts enum higher up * Make CheckpointSyncerType const * Move assertContext to avoid import cycle	2 years ago
webbhorn	401b6e2de9	run-locally: Run 'yarn prettier' after hardhat. (#750) ... Currently the process of starting/running our local hardhat setup results in an annoying irrelevant diff created against a test.json config file. The diff is due to lack of a file-terminating newline character. A better version of this change would probably fix the typescript script that touches / generates that file, but I'm completely unfamiliar with that setup (and TS in general) so opting for this hack for now.	2 years ago
webbhorn	274efcd34d	Restore reverted PR to .gitignore run-locally-induced diffs. (#746) ... This reverts commit 023eacd44b. Also introduce two minor changes: * End rust/.gitignore with a newline. * End test.json with newline, otherwise run-locally removes it, introducing an annoying diff.	2 years ago
Trevor Porter	84400b15c7	Revert "Add "contexts" to infrastructure tooling (#683)" (#741) ... This reverts commit e4a2811176. Co-authored-by: Mattie Conover <git@mconover.dev>	2 years ago
webbhorn	c819982db4	Reduce log severity for already-sent messages. (#735) ... It is expected for the 'processor' module to churn through the entire history of sent messages on relayer init, and it is expected/normal behavior to discover that the vast majority of those have already been sent. Therefore, it is cluttering / inappropriate to log those events at info! severity, and instead preferable to record them at debug severity. Co-authored-by: Mattie Conover <git@mconover.dev>	2 years ago
Trevor Porter	e4a2811176	Add "contexts" to infrastructure tooling (#683) ... * Add contexts * Make validator configs and relayer configs optional * Introduce contexts * Get rid of coreConfig.agent, replace with coreConfig.agents * fix lint * Deployed, just needs some work with RPC urls * Add missing label in rust, disable undesired inboxes * Correctly disable chains, lol * Nit, rename chainNames to contextChainNames * nits * Fix getValidatorKeys * AWS flowcarbon testnet2; don't use default context * Better error when context is undefined * Add relayer funder cronjob context * Update flowcarbon testnet2 img * Fix helm parsing * whitelist * Make Contexts enum higher up * Make CheckpointSyncerType const	2 years ago
Mattie Conover	f1357469a1	reduce "indexed block heights" log level (#719)	2 years ago
Trevor Porter	bf0b5b9a47	Re-add abacus/context label (#716)	2 years ago
webbhorn	87400211a5	Check delivery status on inbox before attempting delivery (#712) ... Restores functionality accidentally lost in #637 wherein we proactively check inbox message_status() call before attempting delivery of a message. * Check whether message has already been delivered before attempting delivery * s/deliver/process	2 years ago
Mattie Conover	8d0509a4d2	Operational cleanup (#707) ... * Reduce log level for common message * retry more of the errors and downgrade log level for non-stop cases * cleanup * reduce error logs	2 years ago
Mattie Conover	ef1ec1c24e	Update metric labels (#697)	2 years ago