703 Commits (203df396dd258a6b83cfb31cb06ddbaadab897bd)

Author	SHA1	Message	Date
Nam Chu Hoai	f6168cbe47	Add MessageProcessor (#287) ... * Add MessageProcessor * Wait for indexed messages * PR review * Fix subtle message processing bugs (#290) * Fix suble message processing bugs * Lint * Simplify	3 years ago
Nam Chu Hoai	a9b509e973	Ignore messages during message processing in TipProver (#281)	3 years ago
Nam Chu Hoai	fae4152221	Set a functioning recipient for kathy (#280)	3 years ago
Nam Chu Hoai	535fc17378	Finalize Abacus key roles (#273)	3 years ago
Nam Chu Hoai	a34858b1be	Read checkpoint syncer from relayer settings (#274)	3 years ago
Nam Chu Hoai	0cc15e67a2	Make deploy optics-environment independent (#275)	3 years ago
Trevor Porter	328941fc2c	Checkpointer policy v1 (#217) ... * Add script for running local dev environment * Prettier * Move Checkpointer to (Abacus)Agent * Lint * Fix * Commit dev files to run checkpointer * Use @abacus-network/utils in solidity/abacus-core/scripts/abacus.ts * Compiles, some warnings to think of * rename checkpoint() -> create_checkpoint() * cargo fmt * Move to index based decision * More info * Move from (H256, u32) to Checkpoint * cargo fmt * Add some scripts for testing * Actually fix merge conflicts * Add latency * Nits * rm testing utils * rm 1000_config.json * nit * fix package-lock.json * Better names * Sleep instead of using last_checkpoint_time * cargo fmt * Rm comment * Add checkpointer to output-agent-env-vars Co-authored-by: Asa Oines <a@celo.org> Co-authored-by: nambrot <nambrot@googlemail.com>	3 years ago
Nam Chu Hoai	9ab0c16dd6	Add CheckpointSyncer configuration in Validator and support S3 (#266) ... * Add CheckpointSyncer configuration in Validator and support S3 * Lint * PR review	3 years ago
Nam Chu Hoai	d3fbd1f9f9	Add relayer scaffold (#225) ... * Add relayer scaffold * Lint * Add Outbox indexing to relayer and determine messages destined for inbox (#227) * Add Outbox indexing to relayer and determine messages destined for inbox * Lint * PR review * Support message processing in relayer (#232) * Support message processing in relayer * Lint * lint * PR review * Add clarifying comment * Be more specific between polling_interval and submission_latency	3 years ago
Nam Chu Hoai	f04959a57b	Support local deploys for agent development (#234) ... * Support local deploys for agent development * Write out base db path * PR review	3 years ago
Nam Chu Hoai	4a28875af8	Add Validator scaffold (#213)	3 years ago
Trevor Porter	28ffe4bccd	Store latest leaf index per destination (#188) ... * Initial pass, confused why referencing a Vec<CommittedMessageWithMeta> isn't turning it into a struct * It compiles, needs cleaning * CommittedMessageWithMeta -> RawCommittedMessageWithMeta * cargo fmt * update_latest_leaf_index_for_destination * nits * cargo fmt * fix tests * cargo fmt * Compiling, rm'd message timestamp * cargo fmt * Undo changes to abacus-test/src/test_utils.rs	3 years ago
Nam Chu Hoai	72ae94e655	Make checkpointer the truly first Abacus agent (#197) ... * Move Checkpointer to (Abacus)Agent * Lint * Fix	3 years ago
Nam Chu Hoai	2cb643486f	Add checkpointer scaffold (#183) ... * Add checkpointer scaffold * Add Abacus ABIs to abacus-ethereum (#186) * Add Abacus ABIs * Build on all PRs * PR comments * lint * Lint * Add new Abacus Outbox/Inbox wrappers (#189) * Add new Abacus Outbox/Inbox wrappers * PR review * PR comments	3 years ago
Nam Chu Hoai	8261b2352b	Auto-heal missing updates (#175) ... * Auto-heal missing updates * Log the committed root for the UpdateSubmitter * Use the already exposed function * Compare against the suggested previous root	3 years ago
Nam Chu Hoai	00d292c514	Add transaction timeout to agent tx submission (#150) ... * Add transaction timeout to agent tx submission * Remove ReceiptError again	3 years ago
Nam Chu Hoai	23c3e4cd22	Add lookback for updates/messages in contract_sync (#144) ... * Apply contract_sync mod patch * Add IndexDataTypes * Fmt * Do not store updates/messages when encountering an invalid continuation If we store them we may end up invariably overwriting the latest_leaf_index database entry which keeps track of "contigousness". I.e. this would cause holes of size >1 to cause the agents being unable to recover * Index both messages and updates on the processor * remove comment * Followups for the contract-sync patch (#146) * Readd abacus_last_known_message_leaf_index to message indexing in the processor * Remove tipbuffer functionality * Additional contract_sync tests (#147) * Fix test case for when batch includes the already known updates/messages * Modify tests to include multiple ranges of missing updates/events	3 years ago
Trevor Porter	46bd6793c9	Move agents to external-secrets, no longer requiring a .env file (#145) ... * Use external-secrets for agents, working on dev, need to handle aws credentials and possibly others * Get AWS support working * Move toward not requiring AWS keys in a local .env * Use us-west-2 as AWS regions in config rather than requiring env vars * Pretty annoying refactor to asynchronously get some secrets from GCP that were previously env vars * Everything seems to be working * Don't pass in any secrets as helm values * Self nit * Fix * Prettier * Rm some unused dotenv	3 years ago
Nam Chu Hoai	767116f57b	Default to prometheus podAnnotations (#140)	3 years ago
Nam Chu Hoai	e3c1b3bdcc	Support tip buffers for contract_sync (#138) ... * Support tip buffers for contract_sync * Pass IndexSettings * Add tipBuffer to deploy tooling * Run prettier * Deploy on dev	3 years ago
Nam Chu Hoai	bf72880763	Final changes for abacus agent deploy (#137) ... * Final changes for abacus agent deploy * Prettier	3 years ago
Nam Chu Hoai	d4c8720700	Rename rust packages (#128) ... * Rename rust packages * rustfmt * More rename * Rename update_abis * Rename metrics.rs	3 years ago
Nam Chu Hoai	91a411e2c9	Add gauge to track last_known_message_leaf_index (#117) ... * Add gauge to track last_known_message_leaf_index * Fix lint * Lint * Lint	3 years ago
Asa Oines	7408737388	Refactor config in optics-deploy (#67)	3 years ago
Nam Chu Hoai	a52eb92d27	Run prettier on rust config (#102)	3 years ago
Asa Oines	7f86a76597	Rename staging, prod to testnet, mainnet, remove community suffix and add legacy suffix (#69)	3 years ago
Asa Oines	83402f4de5	Upgrade replica implementations on mainnet (#65)	3 years ago
Asa Oines	ed719bc9a3	Rotate staging alfajores updater (#62) ... * Fix verification input * wip * Deploy replicas * Fix scripts * Execute * Set updater on staging * Fix configs * Fix contracts.jsons * prettier	3 years ago
Asa Oines	7ddec072e5	Compiles (#47)	3 years ago
Nam Chu Hoai	45d9ce9e9b	Repeat processor reverted txs (#48) ... * Repeat processor reverted txs * Adjust error message	3 years ago
Asa Oines	c0b720de00	Fix development verification info (#45)	3 years ago
Asa Oines	c2e6e959b8	Update dev configs to reflect upgraded replicas (#34) ... * Update dev configs to reflect upgradable replicas * Add back index	3 years ago
Asa Oines	3052427dae	Add owner to Replica (#32) ... * Add owner to Replica * Relinquish * Address comments * Use new optics-multi-provider-community * Tests passing * prettier	3 years ago
nambrot	632cc53ee1	rustfmt	3 years ago
Nam Chu Hoai	8877a98aa8	Support selective index-only for processors (#17) ... * Support selective index-only for processors * Support no indexonly config	3 years ago
Nam Chu Hoai	47ead90aac	Modify deployment tooling for manual processing changes (#16) ... * Modify deployment tooling for manual processing changes * Add docker reference	3 years ago
Nam Chu Hoai	acd06d630e	Add rust .dockerignore (#14)	3 years ago
Nam Chu Hoai	b6caa0da55	Fix S3 proof pushing (#13) ... * Fix S3 proof pushing * Support AWS in getAgentVars * Add staging output-agent-env-vars	3 years ago
Nam Chu Hoai	a3c08207a3	Set default updater pause/interval for productionCommunity (#6) ... * Set default updater pause/interval for productionCommunity * Fix lint	3 years ago
Nam Chu Hoai	db93f1f122	Add dev-community config directory (#12) ... * Add dev-community config directory * Copy devCommunity domain * Add devCommunity to index * Add devCommunity to all index.ts * dev -> devCommunity Co-authored-by: Asa Oines <a@celo.org>	3 years ago
Nam Chu Hoai	d51ef65f5a	Update optics-provider tooling (#5) ... * Tooling to update optics-provider * Add update provider script * Add file * Add invariant violation checking * Refactor * PR comments * Rename to AllConfigs * Add clarifying comment * Fix	3 years ago
Nam Chu Hoai	f5f1addc8f	Add Agent deployment tooling (#3) ... * Add staging-community environment * Agent deploy tooling * Finalize agent tooling * dev deploy * Add dev tooling * Dev deployment * Add env var output script * changes * PR comments * Fix missed replacements * PR comments	3 years ago
Tim Moreton	16588c903a	Optics v2 deployment configs and outputs (#932)	3 years ago
Luke Tchang	40d0ceb253	refactor/feature: split up indexing/contract/db logic + make watcher functional again (#925) ... * refactor: prefixes all loads and stores with home_name or entity in AgentDB * fmt: cargo fmt * refactor: use AgentDB everywhere and scap HomeDB * refactor: rename AgentDB OpticsDB * fix: put watcher back into cargo.toml and fix OpticsDB there * feature: adds ReplicaIndexer and moves index() to Common * refactor: implement CachingHome and CachingReplica + chain agnostic indexer, agent still broken due to not using CachingHome * prog: agent with CachingHome still broken; plan is to provide metrics obj and index-time * fix: contract sync stores messages too * refactor: successfully builds with CachingHome on agent that can spawn sync task * feature: adds unused CachingReplica * refactor: remove contract_name from indexer and give field to contract_sync * refactor: replaces all Replicas usage with CachingReplica * refactor: only CachingHome/Replica reach out to db and implement Event traits * fix: watcher tests work again * fix: removes db references from ethereum home and replica * rebase: rebase big indexer refactor on TypedDB/OpticsDB changes from updater split PR * fix: update crates and silence abigen! warnings for lint * feature: make watcher functional again * rename: spawn_sync --> sync * refactor: fetch_messages returns empty vec by default and home implements method * fix: update watcher-partial config and rename index tasks sync tasks * refactor: HomeIndexer now separate trait than CommonIndexer * doc: document Indexer trait and ContractSync * refactor: Homes/Replicas serve as Arc wrappers * fix: watcher stores update but not dependent on latest root * doc: document watcher fraud behavior * fix: indexers return _sorted_ updates and messages	3 years ago
Conner Swann	4bf9ef0589	updated key script (#924)	3 years ago
Luke Tchang	f007a299c8	feature: add metrics/tracking to remaining agents (#922) ... * feature: add num relayed messages metrics/tracking to relayer * refactor: remove processor-specific nonce storage method from optics db * fix: use countervec for relayer instead of guage * feature: updater uses intcounter vec for submitted update count * fix: remove db from relayer since it now uses countervec with no rocksdb * fix: updates relayed not messages oops * fix: update submitter takes the correct countervec	3 years ago
Conner Swann	7b2c4a21df	refactor: split updater tasks for safety (#909) ... * refactor: split updater tasks, refactor opticsdb * feature: asrefs for db types * refactor: refactor typeddb to hold entity and pair with all loads/stores * ci: cargo +nightly * ci: use nightly toolchain * fix: use 1.56 stable not nightly * fix: updater can never overwrite an existing update with a conflicting one * fix: also check suggested update for state change guard Co-authored-by: Luke Tchang <ltchang@stanford.edu>	3 years ago
Luke Tchang	ea32adf3af	refactor: scrap HomeDB for generalized OpticsDB (#902) ... * refactor: comment out homedb and have typeddb use arg prefixes * refactor: prefixes all loads and stores with home_name or entity in AgentDB * fmt: cargo fmt * fix: keyed encodable/decodable * refactor: use AgentDB everywhere and scap HomeDB * refactor: rename AgentDB OpticsDB * fix: put watcher back into cargo.toml and fix OpticsDB there	3 years ago
ember arlynx	a240facc6d	Balance exporter tool skeleton (#793) ... * First pass at balance exporter tool * this was broken with windows unicode paths * promote optics_base to a facade * optics-ethereum has many fewer lines of code * remove a layer of indirection * update all the other code * fmt * post-mege * flatten core::types::\* * impl Chain for ethers * move balance-exporter into tools * post-merge fixes * post-merge resolution * put Default back	3 years ago
Luke Tchang	eb685bdbf8	refactor: watcher home indexing rewrite (#809) ... * refactor: add HomeDB struct (raw db not replaced yet) * refactor: EthereumHome and HomeIndexer use HomeDB instead of DB * refactor: UpdateHandler uses HomeDB * refactor: processor/prover-sync use HomeDB * refactor: error cleanup * refactor: implements run_all without metrics * refactor: watcher uses oneshot to receive double update * fix: update comments * fix: panic on run and run_many * tracing: add more info when double update found * rebase: fix store_latest_update rename * test: add default impls to make watcher unit tests compile * fix: run_loop takes HomeDB, watcher struct holds DB * run_watch_tasks borrows &self instead of many params * rebase: fix unused imports	3 years ago