Commit Graph
14 Commits
Author SHA1 Message Date
Brian Fitzgerald e1d727d00d wip 2023-12-10 21:19:36 -06:00
Brian Fitzgerald 9b4c79c223 header 2023-12-10 12:07:30 -06:00
Brian Fitzgerald dd5f79d77f update readme 2023-12-10 12:02:43 -06:00
Brian Fitzgerald d00f195158 formatting 2023-12-10 11:41:50 -06:00
Brian Fitzgerald c84f0ed06a update readme 2023-12-10 11:41:26 -06:00
Brian Fitzgerald 98bfaa02ae options for norm sharing and scale 2023-12-10 10:50:09 -06:00
Brian Fitzgerald d40e35e0a7 share group and layer norms 2023-12-10 10:36:59 -06:00
brianf c238be13ef attn patch working 2023-12-10 14:28:44 +00:00
brianf 91020a1974 add gitignore and move to init.py 2023-12-09 21:36:27 +00:00
Brian Fitzgerald a876244ae2 wip - cross attention layer 2023-12-09 09:57:19 -06:00
Brian Fitzgerald fbcc9f51ba wip 2023-12-08 20:30:19 -06:00
Brian Fitzgerald 6404f330c1 wip 2023-12-08 20:13:55 -06:00
Brian Fitzgerald 9003955754 more modules 2023-12-08 19:07:47 -06:00
Brian Fitzgerald cc39cd1cbf initial commit 2023-12-08 18:42:30 -06:00