12 Commits

Include renames

Author	SHA1	Message	Date
jason	15e129295b	wip: use step latents for reference style	2024-01-04 15:40:08 -06:00
brianf	915c562d5e	add qkv options	2023-12-14 01:41:20 +00:00
brianf	be8a2deeec	Bugfix: register shared norm with the copied model	2023-12-13 22:29:38 +00:00
brianf	7b2eba49e3	docs update	2023-12-13 01:19:10 +00:00
brianf	c4f912b310	fix type annotations and add within-batch node	2023-12-12 22:50:13 +00:00
brianf	854a461451	working	2023-12-12 05:12:44 +00:00
Brian Fitzgerald	e1d727d00d	wip	2023-12-10 21:19:36 -06:00
Brian Fitzgerald	c84f0ed06a	update readme	2023-12-10 11:41:26 -06:00
Brian Fitzgerald	98bfaa02ae	options for norm sharing and scale	2023-12-10 10:50:09 -06:00
Brian Fitzgerald	d40e35e0a7	share group and layer norms	2023-12-10 10:36:59 -06:00
brianf	c238be13ef	attn patch working	2023-12-10 14:28:44 +00:00
brianf	91020a1974	add gitignore and move to init.py	2023-12-09 21:36:27 +00:00