pytorch dense layer code example
Example 1: dense layer keras
>>>
>>> model = tf.keras.models.Sequential()
>>> model.add(tf.keras.Input(shape=(16,)))
>>> model.add(tf.keras.layers.Dense(32, activation='relu'))
>>>
>>>
>>>
>>>
>>> model.add(tf.keras.layers.Dense(32))
>>> model.output_shape
(None, 32)
Example 2: torch.nn.Linear(in_features, out_features, bias=True) discription
import torch
import torch.nn as nn
x = torch.tensor([[1.0, -1.0],
[0.0, 1.0],
[0.0, 0.0]])
in_features = x.shape[1]
out_features = 2
m = nn.Linear(in_features, out_features)
%%%%
results would be
>>> m.weight
tensor([[-0.4500, 0.5856],
[-0.1807, -0.4963]])
>>> m.bias
tensor([ 0.2223, -0.6114])
%%%%