3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
gchapman	1d6c291e75	Minor optimization to stop a double .to() being needed	2024-06-18 21:45:10 +01:00
gchapman	03a81eddd5	Get the depth of the model by counting layers to allow for models with more depth. This allows for deeper models to be created. Example: https://huggingface.co/ptx0/pixart-reality-mix which is a 900M model	2024-06-18 21:44:42 +01:00
gchapman	0f888945f5	* Fix SDP attention mask by creating a diagonal mask in the right shape.	2024-05-16 09:23:16 +01:00