Favorite team:LSU 
Location:
Biography:Played golf, then found math
Interests:Finding ways to buy expensive fishing gear without telling my wife.
Occupation:
Number of Posts:2312
Registered on:1/6/2013
Online Status:Not Online

Recent Posts

Message
Instead of leaving it to all of us to prove China is or isn’t a threat. Why don’t you just fill us in with your expert knowledge on why China is or isn’t a threat?
quote:

If you go digging you will find


Can you point me to the best place to start?

I’m genuinely curious.
Thought this was a decent enough talk on the AI Hype machine: LINK

I don’t agree with everything he says but it is a decent enough overview.
When it comes to AI data centers, we’re not heading towards anything remotely considered “build your own.”

However, your diatribe muddied these tens of Gigawatt AI data centers as some sort of a needed infrastructure build out to support common cloud usage needs. These two things are very different than each other.
Are you really suggesting a monopolized cloud infrastructure is a good thing?

re: TPC Sawgrass in August.

Posted by CFDoc on 7/9/26 at 11:22 pm to
Bring loose shorts. You’ll sweat your bag off.

re: Are you a scratch golfer?

Posted by CFDoc on 7/9/26 at 11:19 pm to
Scratch today? Not even close.

But I’m mid 40’s with a wife and two kids.

At my best, I was a D1 college golfer with a +1.9. Played junior golf, AJGA, then college. I got there by playing golf pretty much every day, hours on end, range, short game, lessons, you name it.

re: There is no negotiating with Islam

Posted by CFDoc on 7/8/26 at 8:31 pm to
I truly miss Christopher Hitchens.
quote:

Is that a Ram truck?


Hard to tell from the pic but the keen eye will notice the tailgate opening handle has the convex curve shaped. Dead giveaway it’s a RAM.

re: WTB old Tundra

Posted by CFDoc on 6/28/26 at 8:50 pm to
I’ve heard the statement that emissions made them get rid of the V8 but I honestly have no clue what that means in detail.

I know the government was throwing around money like candy to get them to build EV’s but did some emission law change that would have made selling the 5.7 V8 illegal?

Several manufacturers offer multiple engine choices in a platform. Couldn’t they have done the turbo V6 and the 5.7 V8 as options?

re: WTB old Tundra

Posted by CFDoc on 6/28/26 at 6:56 pm to
I just sold my 2016 Tundra with 271k trouble free miles and bought a 2021 TRD Tundra with 50k miles from gulf states auto in Tuscaloosa.

Toyota is just so stupid for giving up that V8.
quote:

Pretty well known spieth gets around


If his getting around is still the same as it was with the Nikki Amthor thing before the texts got nuked from the internet, that’s some of the most pathetic ‘getting around’ I’ve ever heard of.

But it’s exactly the way I’d imagine spieth doing it.
quote:

Frontier AI will be reserved for use by select few organizations.


People are going to assume all sorts of things as to why the AI future is going to be highly controlled and limited. In reality, the math (cost and energy) required to build and maintain AI Frontier models is insane.

The Efficient Compute Frontier for AI roughly estimates that we are within about 10-15 years of a single Frontier AI model (either JEPA or GPT based) requiring roughly a Terawatt to build/maintain.

For reference, the entire Earth requires about 18 Terawatts of continuous power. So 20 AI companies in 10 years could easily require an entire Earth’s power grid worth of energy to operate.

All that to say, AI is going to be highly controlled because there’s no form of government or political system that is going to allow a product to operate at that scale without massive control parameters.

On top of that, you can throw all the other stuff like security, control, and whatever other socioeconomic theory you can come up with.
quote:

I've never asked, but this conversation has curiously gone from "it's easy" to "it's a secret".


So I went back and read my original posts and I’ll own up to using poor wording when I said it was ‘easy.’

My intent was to describe how deterministic and low dimensional spaces are ‘easy’ to exploit. More of a generality.

At this point, you are correct that it is not easy to exploit a GPU. What I am seeing is progress in research that essentially breaks a GPU down into a low dimensional, deterministic space when operated in transformer architectures. This is news since, for some time now, the general consensus was more along the lines that LLMs were uncontrollable stochastic dart throwers.

Maybe the details will become more public in the near future. But for now, the cybersecurity firm I’m doing work for requires otherwise.
quote:

Your claim seems to be that there is something specific to GPUs that that reduces the diversity


Yes, that is precisely the claim.

And like I mentioned, from what I’ve seen to date, there’s exploits that work when running an LLM on a GPU that do not work when running the exact same LLM on another architecture. It is the very fundamental physical makeup of the GPU that allows for it.

And no, I’m not sharing IP with you on this topic.

quote:

They don't use CISC, they use SASS as the instruction for the tensor core, it's fundamentally different from RISC-V.

It's at the lowest level that the sheer volume of data (the transformer architecture) is what has been giving us the leaps and bounds improvement.


SASS is not the only instruction set for tensor cores.

My argument has nothing to do with improving LLMs.

At this point I think we’re just talking past each other. It’s prolly time to end the conversation and just go have a beer.

quote:

If it doesn't then there was nothing there.


This is categorically false.
quote:

They are also more diverse than you are willing to admit, we've seen huge differences in going from FP 16 to FP 4.


The diversity almost completely disappears when applied to LLMs though. That’s the link I’ve been trying to explain (and admittedly probably doing a poor job).

quote:

You say that but FP4 doesn't even use RISC, thats all tensor core. Tensor core is why the B200 is insane.


???

Maybe you know something I don’t but all the FP-4 I’ve tested still based their instructions off of RISC-V, or some other reduced instruction model. Does nvidia even support CISC at the chip level?

CUDA vs Tensor doesn’t really matter when it comes to the on board instruction set. So I’m confused as to what you’re referring here.

quote:

Look it's an interesting theory, and maybe there is something to it, but your statements are far too broad without data to back it up


From what I’ve seen to date, there’s a ‘there’ there. Whether or not it makes it into open literature, who knows.
quote:

what chipsets do people think this hardware determism is actually predictable


Chipsets don’t have free will.

And chipsets based on SIMT coupled with RISC-V controllers really really really don’t have free will.

And I’m completely ok with you not believing me.
quote:

I think he is looking for funding for his NGO...


Nobody in this area is having issues with funding.
quote:

It doesn't really have anything to do with exploitation of physical chip sets, that paper seems wholly unconnected to GPU architectures.


That paper doesn’t have anything to do with GPU architectures. That paper is more of an example of how recent literature is showing how to deterministically control heteroscedasticity of an LLM. Essentially drawing determinism out of what’s fundamentally a stochastic model.

I don’t know if the open literature is actively publishing exploits of gpu architectures yet or not. I’m just telling you it’s an active topic in the field. And yes, Ampere, Hopper, Blackwell, and Vera Rubin matter. However, at the transistor/ALU level, coupled with RISC, it makes all GPUs much more reverse engineer-able.

TPUs are a different story.
quote:

But I think it really is a cyber security issue


Did you see copy.fail ?

That was just a precursor and that is full root access to almost every single Linux distribution from the last 10 years all wrapped up in a 700 byte Python file.