PyTorch 100问

1. 查看PyTorch版本

import torch
print(torch.__version__)

2. 模型参数量

    model = FPN()
    num_params = sum(p.numel() for p in model.parameters())
    print("num of params: {:.2f}k".format(num_params/1000.0))
    # torch.numel()返回tensor的元素数目，即number of elements

3. 打印模型

    model = FPN()
    num_params = sum(p.numel() for p in model.parameters())
    print("num of params: {:.2f}k".format(num_params/1000.0))
    print("===========================")
    #for p in model.parameters():
    #    print(p.name)
    print(model)

4. with torch.no_grad()

with torch.no_grad():
    # code no gradient Here!

5. 激活函数torch.nn.ReLU(inplace=False)

• 官方文档：https://pytorch.org/docs/stable/nn.html#relu
• inplace的作用：https://www.cnblogs.com/wanghui-garcia/p/10642665.html
• 节省显存小技巧：Pytorch有什么节省显存的小技巧？ - 郑哲东的回答 - 知乎
  https://www.zhihu.com/question/274635237/answer/573633662