 gchapman
|
91340dedc7
|
Fix loader depth
|
2024-06-18 23:56:10 +01:00 |
|
|
gchapman
|
5b082f424d
|
Revert "Use correct key to get the number of layers, I accidentally used a layer with a 'final' layer giving me an out by one error"
This reverts commit e43ecbeb64.
|
2024-06-18 23:42:08 +01:00 |
|
|
gchapman
|
e43ecbeb64
|
Use correct key to get the number of layers, I accidentally used a layer with a 'final' layer giving me an out by one error
|
2024-06-18 23:24:30 +01:00 |
|
|
gchapman
|
1d6c291e75
|
Minor optimization to stop a double .to() being needed
|
2024-06-18 21:45:10 +01:00 |
|
|
gchapman
|
03a81eddd5
|
Get the depth of the model by counting layers to allow for models with more depth. This allows for deeper models to be created. Example: https://huggingface.co/ptx0/pixart-reality-mix which is a 900M model
|
2024-06-18 21:44:42 +01:00 |
|
|
gchapman
|
0f888945f5
|
* Fix SDP attention mask by creating a diagonal mask in the right shape.
|
2024-05-16 09:23:16 +01:00 |
|