行业

Ben Affleck 谈 Python 与视觉特效中的机器学习

Quoting Ben Affleck

精选理由

本·阿弗莱克居然能写 Python,还把张量和卷积神经网络讲得挺明白,演员里少见,看看他怎么理解视觉特效里的机器学习。

Ben Affleck 在一段访谈中自述能写“比较烂的”Python 脚本。他解释了卷积神经网络在视觉特效流程中的应用:把图像转成包含帧号和 RGB 像素值的张量,再用 CNN 做边缘检测和特征提取,方便抠绿幕。他称 CNN 是 transformer 的前身,区别在于 transformer 能同时做更多计算。

原文 · Simon Willison’s Weblog

Quoting Ben Affleck

I've always been kind of into computers since I was young. And then when film started to move from analog film to digital, I became more interested in that aspect of it. And the visual effects workflow for many years has included machine learning. So I can write like pretty shitty Python scripts and stuff like that because with convolutional neural networks, which were the sort of precursors to what the transformer can do, which is just much more computation simultaneously, you would do things like look at what's called a tensor, which is just the numerical translation of a visual image in numbers — like the batch number, the frame number, the red, green, and blue values of each pixel in each frame. And a tensor, you use a convolutional neural network to identify patterns in that that would reveal what's called edge detection or feature extraction, which is just identifying patterns enough to know like this is where the window ledge is, so we can more easily take the green screen image out and replace it with something. — Ben Affleck , Pythonista Tags: machine-learning , python