Lightnews — Scholar-powered news

LightNews

Feldera

@feldera.bsky.social

120 followers 190 following 65 posts

Incremental Computing for AI, ML and Data teams. Feldera.com

Posts Media Videos Starter Packs

Feldera @feldera.bsky.social · Sep 6

If you’re excited about hard technical problems and want to shape the future of real-time systems, Feldera is hiring (remotely!) for a Solutions Engineer (Enterprise) and a Software Engineer (Reliability, Performance)

jobs.ashbyhq.com/feldera/544a...

jobs.ashbyhq.com

Reposted by Feldera

Ben Pfaff @benpfaff.bsky.social · Sep 2

Some of my work at @feldera.bsky.social involves containers. I keep getting spam from some vendor who wants to sell me casters to put on the containers 🤣

Hi Ben,

I wanted to follow up on my recent note about your containerized solutions. If Feldera is exploring ways to improve mobility or streamline deployment, our container wheels could be a great fit.

Here’s what our solutions offer:

Increased flexibility
Reduced operating costs
Safe and practical mobility
A more sustainable option

With logistics hubs in both the US and EU, our casters are already helping teams in container rental, storage, and logistics cut down on equipment costs, labor, and time.

Feldera @feldera.bsky.social · Aug 20

"This is the true power of incremental compute. By only needing compute resources proportional to the size of the change, instead of the size of the whole dataset, businesses can dramatically slash compute spend for their analytics."

👇

www.feldera.com/blog/how-fel...

How Feldera Customers Slash Cloud Spend (10x and beyond)

By only needing compute resources proportional to the size of the change, instead of the size of the whole dataset, businesses can dramatically slash compute spend for their analytics.

www.feldera.com

Reposted by Feldera

Ben Pfaff @benpfaff.bsky.social · Aug 20

At @feldera.bsky.social I've been doing a lot of performance work. I needed an easy way to watch the Prometheus metrics for a pipeline, so I wrote a simple tool for the Feldera CLI that shows the pipeline metrics. Here's the progress of a pipeline that runs in about 30 seconds.

Feldera @feldera.bsky.social · Aug 18

If you've written even the most basic compute program, you've likely already written programs that "integrate".

Integration is central to Feldera and its underlying theory of incremental compute. It is also all around us in the real world! 👇

Stream Integration

In this blog post we informally introduce one core streaming operation: integration. We show that integration is a simple, useful, and fundamental stream processing primitive, which is used not only…

www.feldera.com

Feldera @feldera.bsky.social · Aug 5

The future of data security isn't about choosing between compliance and performance. It's about making security a performance feature.

Learn how to implement fine-grained authorization without performance penalties: docs.feldera.com/use_cases/fi...

Feldera @feldera.bsky.social · Aug 5

What if you could have both security AND speed?
Modern fine-grained authorization embeds security directly into data processing, delivering:

- Microsecond authorization decisions
- Real-time row/column-level filtering
- Automated compliance reporting
- Actually improved query performance

Feldera @feldera.bsky.social · Aug 5

What are some the the typical challenges?
- 300-500ms latency added per query
- Complex compliance audits taking weeks
- Manual permission tracking via spreadsheets
- Performance degradation with granular controls

Feldera @feldera.bsky.social · Aug 5

Traditional authorization systems force an impossible trade-off: secure data access OR fast query performance. With SOX compliance audits intensifying and data breach costs averaging $4.45M, this choice is becoming a business risk.

Feldera @feldera.bsky.social · Aug 5

"We chose performance over security" - a dilemma no data team should face.

#DataEngineering #DataSecurity #RealTimeAnalytics

Feldera @feldera.bsky.social · Jun 18

New tech talk:

How to Incrementally Get Results from Your Graph Data with Feldera.

Interested in practical techniques for incremental computation or want to see how this fits into modern data engineering workflows?

Check it out: youtu.be/vpVAZbaZ2Hg

How to Incrementally Get Results from Your Graph Data with Feldera

YouTube video by Feldera, Inc.

Feldera @feldera.bsky.social · Jun 17

Mihai Budiu, our exceptional Chief Scientist, won the 2025 #ACM #SIGCOMM Networking Systems Award for his groundbreaking work on #P4.

Details: www.sigcomm.org/awards/sigco...

Feldera @feldera.bsky.social · Jun 17

📢 Webinar - Tomorrow! -6/18 at 9am PST-

Stop re-running complex recursive queries when your graph data changes. Feldera incrementally evaluates recursive graph computations-ideal for real-time applications in authorization, networks, and observability.

Sign Up - t.co/0iWPIMZY8C

Feldera @feldera.bsky.social · Jun 17

Don't miss our webinar tomorrow! -6/18 at 9am PST-

Stop re-running complex recursive queries when your graph data changes. Feldera incrementally evaluates recursive graph computations-ideal for real-time applications in authorization, networks, and observability.

tinyurl.com/rb5my7d8

How to Incrementally Get Results from Your Graph Data with Feldera

In this webinar, you'll learn how Feldera incrementally evaluates recursive graph computations.

Feldera @feldera.bsky.social · Jun 11

📢 Webinar - 6/18 at 9am PST!
Stop re-running complex recursive queries when your graph data changes. Feldera incrementally evaluates recursive graph computations. Learn to easily build these mechanisms with #SQL, without the hassle of constant recomputation.
tinyurl.com/rb5my7d8

Feldera @feldera.bsky.social · Jun 5

We’ll be at the #Databricks Data + AI Summit in SF next week (6/9–12).

If you’re around and want to chat about how incremental computing can make your #SparkSQL workloads go from hours to seconds — let’s connect.

Grab some time here: calendly.com/matt-feldera...

#DataAISummit #DataEngineering

Reposted by Feldera

Ben Pfaff @benpfaff.bsky.social · May 22

Today, the USENIX newsletter ;login: published an interview with me: www.usenix.org/publications.... Read it to find out about Open vSwitch, @feldera.bsky.social, and more!

Interview with Ben Pfaff

Feldera @feldera.bsky.social · May 28

We broke it down in our blog: www.feldera.com/blog/medalli...
You can kick the tires at try.feldera.com

Feldera @feldera.bsky.social · May 28

3/ The best part? The rest of the stack stayed untouched.

Same Delta tables, same BI tools—just a lot less waiting.

Feldera @feldera.bsky.social · May 28

2/ Instead of a full re-architecture, we swapped out the batch jobs for Feldera’s Incremental View Maintenance engine.

Now, gold-layer dashboards update in seconds, not hours.

Feldera @feldera.bsky.social · May 28

🧵1/ Real-Time Medallion, No Re-Architecture Required.

A customer came to us with a classic Medallion setup: Spark + Delta Lake, batch jobs moving data from bronze to gold. It worked—until users started asking for fresher insights.

Feldera @feldera.bsky.social · May 22

Feldera's Chief Scientist, Mihai Budiu will be giving a talk on the convergence between stream processing and databases at EventCentric in Antwerp on June 4: 2025.eventcentric.eu/program/unif...

EventCentric | For people who architect, build, and run event-driven systems | June 4-5EventCentric 2025 - Program

Non-vendor led conference on building event-driven systems. Antwerp, June 4-5 2025

2025.eventcentric.eu

Feldera @feldera.bsky.social · May 8

docs.feldera.com/use_cases/ba...

Part 1: Create a Spark SQL batch job | Feldera Documentation

This tutorial demonstrates how to convert a traditional batch job into an

docs.feldera.com

Reposted by Feldera

Lalith Suresh @lalithsuresh.bsky.social · May 2

It's a wonderful time to join us at @feldera.bsky.social! 🚀

If you're a systems engineer who loves working on data-intensive systems and is fluent in Rust, Kubernetes, Docker and cloud tech, do apply!

jobs.ashbyhq.com/feldera/9754...

Software Engineer: Cloud

Software Engineer: Cloud

jobs.ashbyhq.com

Feldera @feldera.bsky.social · May 8

Learn how to transform your slow batch jobs into real-time, always-up-to-date insights with our new user guide for converting Spark jobs to incremental Feldera pipelines.
www.feldera.com/blog/warpspeed