113 Commits (7f86a76597cdba8c1705a36c3d73e1db46634742)

Author	SHA1	Message	Date
Luke Tchang	40d0ceb253	refactor/feature: split up indexing/contract/db logic + make watcher functional again (#925) ... * refactor: prefixes all loads and stores with home_name or entity in AgentDB * fmt: cargo fmt * refactor: use AgentDB everywhere and scap HomeDB * refactor: rename AgentDB OpticsDB * fix: put watcher back into cargo.toml and fix OpticsDB there * feature: adds ReplicaIndexer and moves index() to Common * refactor: implement CachingHome and CachingReplica + chain agnostic indexer, agent still broken due to not using CachingHome * prog: agent with CachingHome still broken; plan is to provide metrics obj and index-time * fix: contract sync stores messages too * refactor: successfully builds with CachingHome on agent that can spawn sync task * feature: adds unused CachingReplica * refactor: remove contract_name from indexer and give field to contract_sync * refactor: replaces all Replicas usage with CachingReplica * refactor: only CachingHome/Replica reach out to db and implement Event traits * fix: watcher tests work again * fix: removes db references from ethereum home and replica * rebase: rebase big indexer refactor on TypedDB/OpticsDB changes from updater split PR * fix: update crates and silence abigen! warnings for lint * feature: make watcher functional again * rename: spawn_sync --> sync * refactor: fetch_messages returns empty vec by default and home implements method * fix: update watcher-partial config and rename index tasks sync tasks * refactor: HomeIndexer now separate trait than CommonIndexer * doc: document Indexer trait and ContractSync * refactor: Homes/Replicas serve as Arc wrappers * fix: watcher stores update but not dependent on latest root * doc: document watcher fraud behavior * fix: indexers return _sorted_ updates and messages	3 years ago
Conner Swann	7b2c4a21df	refactor: split updater tasks for safety (#909) ... * refactor: split updater tasks, refactor opticsdb * feature: asrefs for db types * refactor: refactor typeddb to hold entity and pair with all loads/stores * ci: cargo +nightly * ci: use nightly toolchain * fix: use 1.56 stable not nightly * fix: updater can never overwrite an existing update with a conflicting one * fix: also check suggested update for state change guard Co-authored-by: Luke Tchang <ltchang@stanford.edu>	3 years ago
Luke Tchang	ea32adf3af	refactor: scrap HomeDB for generalized OpticsDB (#902) ... * refactor: comment out homedb and have typeddb use arg prefixes * refactor: prefixes all loads and stores with home_name or entity in AgentDB * fmt: cargo fmt * fix: keyed encodable/decodable * refactor: use AgentDB everywhere and scap HomeDB * refactor: rename AgentDB OpticsDB * fix: put watcher back into cargo.toml and fix OpticsDB there	3 years ago
ember arlynx	a240facc6d	Balance exporter tool skeleton (#793) ... * First pass at balance exporter tool * this was broken with windows unicode paths * promote optics_base to a facade * optics-ethereum has many fewer lines of code * remove a layer of indirection * update all the other code * fmt * post-mege * flatten core::types::\* * impl Chain for ethers * move balance-exporter into tools * post-merge fixes * post-merge resolution * put Default back	3 years ago
Luke Tchang	eb685bdbf8	refactor: watcher home indexing rewrite (#809) ... * refactor: add HomeDB struct (raw db not replaced yet) * refactor: EthereumHome and HomeIndexer use HomeDB instead of DB * refactor: UpdateHandler uses HomeDB * refactor: processor/prover-sync use HomeDB * refactor: error cleanup * refactor: implements run_all without metrics * refactor: watcher uses oneshot to receive double update * fix: update comments * fix: panic on run and run_many * tracing: add more info when double update found * rebase: fix store_latest_update rename * test: add default impls to make watcher unit tests compile * fix: run_loop takes HomeDB, watcher struct holds DB * run_watch_tasks borrows &self instead of many params * rebase: fix unused imports	3 years ago
James Prestwich	985bd7850c	feature: configuration to push proofs to s3 buckets (#821) ... * feature: configuration to push proofs to s3 buckets * refactor: key s3 proofs by their index, not their leaf hash * chore: improve processor bootup logging * fix: add name and bucket to debug for Pusher * bug: check that content-length is gt 0 * bug: expect 3 labels in next_message_nonce metric * bug: properly handle non-existent key * fix: log messages for proof pushing * feature: upload message to s3 with proof	3 years ago
ember arlynx	fdd7c64d72	404 on non-metrics endpoints on metrics server (#819)	3 years ago
ember arlynx	e23625fbef	feature: record span durations as a metric (#759) ... * record span durations as a metric * kathy is just like the others * show rest of comment its contents were hiding in my brain * -Default	3 years ago
James Prestwich	0aba12bb9c	Prestiwch/polygon metrics fix (#783) ... * refactor: move block height tracking to the HomeIndexer, temporarily disable replica block height tracking * chore: enhance updater main comment * refactor: beta reduction	3 years ago
James Prestwich	39b7fc5964	Prover sync refactoring (#781) ... * refactor: display impl for ProverSync * refactor: make prover internal only * refactor: remove non-functional gas escalator * refactor: disable watcher, task management refactor * fixed Docker build Co-authored-by: Conner Swann <me@connerswann.me>	3 years ago
James Prestwich	ce79bb1c5a	refactor: improve db and test roundtrip store/load (#774) ... * refactor: improve db and test roundtrip store/load * refactor: improve tracing messages in processor * refactor: home event getters rely only on db now * feature: more tx info in report_tx tracing	3 years ago
James Prestwich	11d2ec0c5d	prestwich/home indexing (#768) ... * refactor: move db into optics-core, pass db to home instantiation * feature: prototype chain indexer * chore: add todo comment * feature: make chunk_size configurable * refactor: improve DB through out the codebase * bug: use to in indexer spawn * feature: tracing in home indexer * refactor: indexer settings are strings * feature: add setting to disable replica #767 * feature: store latest leaf_index in db * refactor: make fetch_leaf dependent only on DB * feature: add index config to kovan testnet * chore: increase polygon chunk size to 9999	3 years ago
ember arlynx	2767fd921c	feature: additional agent metrics (#746) ... * use a label for replica dimensioning, not a separate metric name * use labels in updater metric for attestation count * don't use non-Vec metrics * track the block height metric * fix typos	3 years ago
James Prestwich	c9a1cd520b	bug: metrics no longer panics when attempting to register multiple replicas (#735)	3 years ago
ember arlynx	d5745362c6	rust agents: expose prometheus metrics (#670) ... * expose prometheus metrics from agents currently not actually updated in the course of execution * cargo update * log when starting metrics server, or not * metricsport -> metrics * metrics ought to be string * set content-type	3 years ago
Anna Carroll	6f5f51d97a	Remove queue from Replica (#703) ... * Remove queue from Replica * Update rust * Lint * Fix test order	3 years ago
Anna Carroll	5ba0bed73a	Final Contract Cleaning + Renaming (#698) ... * Rename Pending to Proven; make case for enums consistent * Replica docs * GovernanceRouter docs * Fix test error message * XAppConnectionManager docs * Remove is_owner from rust * Remove isOwner test * Rename enqueue => dispatch * Update tests to remove enqueue * Rename enqueue in rust * Fix: disapatch * Rename sequences => nonces * Rename sequences => nonces * fix lint * Rename current => committedRoot * Rename leaf => messageHash * Rename endBlock => recoveryActiveAt * Fix test gen	3 years ago
James Prestwich	5b3b299c28	nit: typo in info message	3 years ago
James Prestwich	7de6914863	feature: log db status at agent bootup	3 years ago
ember arlynx	22e9c1adc2	refactor processor to have nicer behavioural traces (#593) ... * rust agents: use OTLP for tracing the processor has also been tweaked impl Encode/Decode for u32 * final cleanups * stray comment b gon	3 years ago
Anna Carroll	567631e510	Remove nextToProcess from Replica (#629) ... * Remove nextToProcess from Replica * Get tests passing * package-lock * refactor: remove next_to_process from rust Co-authored-by: James Prestwich <james@prestwi.ch>	3 years ago
ember arlynx	5f041c9db1	drive-by cleanups (#592) ... * reorganize rust code into dirs * rust: ignore vendor dir * how did kathy go missing? * drive-by cleanups: abstraction in update_abis, hyperlink, shell scripts are mostly shellcheck clean * rust readme: note agents dir * cargo fmt --all * remove stray comment * cargo update * why am i fighting my computer rn * patch over sloppy rebase * shore up test vector file handling * clarify how to add a new chain * add rust-toolchain.toml for 1.54 * DRY abis_dir * chore: add clippy installation to CI * github actions will use rust-toolchain.yaml now * move rust-toolchain so the action will find it rustup seems to scan upwards for this file, should pick it up fine when using from within * use obsolete rust-toolchain file location, because the action is naive * chore: specify toolchain in rust.yml * chore: specify toolchain in rust.yml in all workflows * chore: return clippy to rust.yml Co-authored-by: ember arlynx <ember@lunar.software> Co-authored-by: James Prestwich <james@prestwi.ch>	3 years ago
James Prestwich	fab6a6d428	bug: properly handle already initted kms client (#614)	3 years ago
ember arlynx	0ce22d65fe	refactor: fewer trait impls in tracing setup (#545) ... mainly just looks nicer to read	3 years ago
James Prestwich	13644d5957	KMS CLI (#547) ... * feature: sweep bin * refactor: hardcode gas req for simple sweep tx * refactor: update to latest version of ethers * feature: kms cli * bug: short designator conflict + docs * bug: fix value parsing * chore: temp fix for simple sends * refactor: delete deprecated kms bins, roll features into kms-cli	3 years ago
James Prestwich	534ee25b90	test: de minimis test for style deser	3 years ago
James Prestwich	36f3aa937c	docs: add more settings rustdoc	3 years ago
James Prestwich	9300133dd5	refactor: rename key_id to id	3 years ago
James Prestwich	7b501442b1	refactor: add aws signer (#516) ... * refactor: add aws signer * lint: clippy and fmt * lint: fix unsequenced reads * feature: add a small bin to print key address	3 years ago
James Prestwich	a38f4f5153	chore: bump ethers to main in all cargo.toml files	3 years ago
James Prestwich	aff52ce2a9	bug: tracing and pending txn fixes ... - use branch of ethers-rs with pendingtx poll delay - use tracing::Instrumented in most agent trait methods - add in_current_span to most spawns - add an id generator to jaeger tracing	3 years ago
James Prestwich	677f68c1e1	feature: zipkin	3 years ago
James Prestwich	5722a698f2	Refactor tracing subscriber instatiation (#466) ... * WIP(broken): start breaking out tracing config * WIP: custom abstraction over log formats * WIP(feat): clean jaeger instantiation in Subscriber layers * refactor: improve jaeger layer instantiation and application. Add filter layer * lint: self by value on copy type * feature: implement Jaeger configuration * bug: specify reqwest collector client and remove doc fragment * refactor: use std convert traits where possible * refactor: introduce DroppedError	3 years ago
James Prestwich	1593d3b0c9	feature: time out txns that have been pending confirmation for 10m (#457)	3 years ago
James Prestwich	56139b1715	bug: remove leftover dbg	3 years ago
James Prestwich	a37a6ed776	Prestwich/rust config (#419) ... * improve configuration handling of env vars - improve decl_settings macro to name the declared structs - change domains and timers to String - rename chat_gen to chat in kathy settings - panic on failed uint parsing in settings deser * bug: update typescript deploy to output string domains * chore: update new deploy conf to match new format * chore: set kathy destination to 3000 for now * refactor: ensure kathy dispatches messages to each comnfigured replica	3 years ago
James Prestwich	e6becba053	refactor: several rust improvements (#414) ... * refactor: several rust improvements - add partials to latest deploy - fix the prefix iterator in db - run the core updater loop in the current span - correct a processor bug that would prevent startup after any proofs were cached - correct a processor bug that would prevent startup with the initial tree * feature: root acceptability checks - expose acceptableRoot in Replica.sol - check if the root is acceptable before dispatching a proof from the processor	3 years ago
James Prestwich	6487fcb3eb	Processing Refactor (#409) ... * refactor: have proversync cache proofs upon tree update * refactor: start introducing acceptableRoot into replica * refactor: set confirmAt to 1 for initial root * refactor: remove previous from replica trait * refactor: processor no longer bails on missing proof * tests: fix the tests * refactor: remove last use of tokio::time::interval * refactor: remove redundant condition in replica	3 years ago
James Prestwich	41b19b70dd	refactor: add prove_and_process to replicas enum	4 years ago
James Prestwich	76ab2034d8	refactor: fix the annoying process bug. misc rust updates	4 years ago
James Prestwich	ac58c6a1cb	feature: MessageStatus	4 years ago
James Prestwich	26b4af5951	refactor: many processor improvements	4 years ago
James Prestwich	bb2768384a	bugs: lots of rust agent bugs	4 years ago
James Prestwich	42db34b8c0	bug: dbg print left in	4 years ago
James Prestwich	d99f15c041	bug: configuration bugs wrt config and hexstring	4 years ago
James Prestwich	5489c5f22c	refactor: break signers out of replicas in rust configs (#381) ... * refactor(wip): break signers out of replicas in rust configs * chore: update configs files with new format	4 years ago
James Prestwich	40ae9257de	feature: use OPT_BASE and document config precedence	4 years ago
James Prestwich	31539b786a	Prestwich/hex string rust (#378) ... * feature: hex string for configuration * chore: test vectors * chore: remove dbg prints * chore: cleanup import and extra line * chore: remove unused dep	4 years ago
Conner Swann	2c42635e0a	initial dockerfile implementation ... update_abis script moved config, moved abis, fixed macros and scripts added release scripts fix abi import redirect abi check to new location fix tests pre-commit nits moved config dir, load from current directory, not parent	4 years ago
James Prestwich	daa9df9436	Prestwich/ts deploy (#366) ... * feature: basic typescript setup refactor: clean up and trim down remote config feature: deployHubAndSpoke refactor: await deploy transactions feature(tmp): allow gas price specification refactor: break proxy utils into their own file refactor: move toChain with chain config types feature: more concurrency refactor: lots feature: refactor to almost working deploy gitignore * gitignore again * deploy: first deploy * feature: initial deploy * feature: write two chain output * feature: nother alfa-goerli deploy * feature: allow env specification of base config * bug: specify env separator character * feature: some more logging on the rust agents * feature: settings uses replica map instead of list * feature: gas escalation in contract instantiation * chore: gitignore newline * config: Jun-1 alfa-goerli deploy	4 years ago