You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I was wandering whether it makes sense from an efficiency point of view to change the Conv1D layer with kernel 1 from the conformer encoder to standard linear layers.
As I understand the operation is the same and a linear layer is ~10x faster.
Am I correct or am I missing something?
The text was updated successfully, but these errors were encountered:
❓ Questions & Help
I was wandering whether it makes sense from an efficiency point of view to change the Conv1D layer with kernel 1 from the conformer encoder to standard linear layers.
As I understand the operation is the same and a linear layer is ~10x faster.
Am I correct or am I missing something?
The text was updated successfully, but these errors were encountered: