Home Big Data Yape: An Energetic Metadata Pioneer – Atlan

Yape: An Energetic Metadata Pioneer – Atlan

Yape: An Energetic Metadata Pioneer – Atlan


Governing Databricks and Democratizing Knowledge Entry with Atlan

The Energetic Metadata Pioneers sequence options Atlan clients who’ve just lately accomplished an intensive analysis of the Energetic Metadata Administration market. Paying ahead what you’ve realized to the subsequent knowledge chief is the true spirit of the Atlan neighborhood! In order that they’re right here to share their hard-earned perspective on an evolving market, what makes up their fashionable knowledge stack, modern use circumstances for metadata, and extra.

On this installment of the sequence, we meet Jorge Plasencia, Knowledge Catalog & Knowledge Observability Platform Lead at Yape, a fast-growing fee app from Monetary Companies holding firm Credicorp, providing a P2P digital pockets to greater than 13 million customers throughout Peru. Jorge shares how Yape carried out a rigorous analysis of recent knowledge catalogs, and the capabilities and experiences that have been essential for Yape to attain its knowledge governance targets.

This interview has been edited for brevity and readability.

May you inform us a bit about your self, your background, and what drew you to Knowledge & Analytics?

I’m an Industrial Engineer, and I began working within the BI world for Mondelez, a CPG firm. Then, I realized low-code/no-code instruments like Alteryx. Lastly, 4 years in the past, I had the chance to study extra about Knowledge Governance and this unimaginable framework of bettering the productiveness of crew members, guiding the work they do utilizing insurance policies, pointers, and requirements about knowledge administration.

I realized that individuals from throughout should be concerned in that course of. Not solely IT wants context about knowledge, understanding the which means of a discipline or how knowledge is flowing from one system to a different, but in addition enterprise customers and groups like Advertising and HR. And should you can construct a knowledge tradition in your organization, the adoption of those customers can enhance exponentially.

Now, I lastly have the chance to implement a knowledge catalog, myself.

Would you thoughts describing Yape?

We’re the most important digital pockets right here in Peru. We provide an utility you can set up in your cell phone. Our core enterprise is a P2P digital pockets the place you may make a transaction utilizing a QR code or simply utilizing your telephone quantity, however we’re reworking proper now and shifting past simply P2P wallets.

We wish to be a digital ecosystem right here in Peru. For instance, we now have a market embedded in our app the place you should buy tech and family merchandise from well-known sellers, and we’re enabling different options resembling gaming and ticketing, as nicely. Proper now, we now have greater than 13 million customers.

May you describe your knowledge crew?

Now we have 4 specializations, Knowledge Engineering, Knowledge Science, Machine Studying Engineering, and Analytics Translators. 

Knowledge Engineers develop knowledge pipelines and automate ETL workflows and keep our knowledge platform. Knowledge Scientists are centered in modeling. ML Engineers are in command of creating, deploying, and sustaining fashions and experiments in our MLOps platform. Translators assist join enterprise customers with analytical options, and determine and measure the impression generated.

The Knowledge Governance crew is embedded in Knowledge Engineering. We’ve been available in the market for six years. We’re a younger firm, and we’re simply beginning to enhance our knowledge literacy, and enhance our knowledge processes and maturity degree. So we’re a part of Knowledge Engineering as a result of each groups work intently collectively, and their chief is aware of loads about knowledge governance and the best way to drive worth from it.

May you describe your knowledge stack?

We’re Microsoft Azure based mostly, with Azure Occasion Hub, and Confluent Kafka to maneuver streaming knowledge into Databricks. For visualization, we’re implementing Energy BI.

How did your seek for an Energetic Metadata Administration platform begin? What was necessary to you?

With my knowledge catalog expertise, I began as an knowledgeable on validation of different instruments like Alation, Collibra, and Informatica, and once I had the chance to hitch Yape this 12 months, I used to be main the analysis and acquisition means of our new software. So I began asking what instruments we had, what instruments we have been evaluating, and if what we had was appropriate or if we needed to change the scope a bit bit.

At the moment, we have been evaluating Atlan, Ataccama, and Collibra, based mostly on preliminary market analysis. Collibra is likely one of the catalogs with extra years in-market, however I noticed that it didn’t meet our expectations as a result of by early 2023, their integration with Databricks Unity Catalog wasn’t the most effective. We would have liked a software that had an excellent integration with Databricks. It’s our lakehouse, and is our important supply. 

However greater than Databricks, we wanted a platform for innovation to remain forward of our opponents. We’d know what we’d like proper now, but when the market is shifting in a brand new route, with AI and Chat GPT, for instance, we have to have a solution for that, and the chance to attempt these instruments in our knowledge catalog. That’s what I actually preferred about Atlan. You’re consistently innovating with the most recent developments, you’ve gotten Atlan AI, you help Knowledge Mesh natively and improve it together with your new product, Atlan Mesh.

So I had to decide on a brand new checklist of three instruments to be a part of our analysis, and we moved on with Atlan within the first place, then Alation and Secoda. 

We had a preliminary evaluation with 20+ instruments, with some necessary standards that led us to these three selections. First was ease-of-use, as a result of we have to drive adoption with our finish customers, and in the event that they don’t use the software confidently, this wouldn’t work. Second was we wanted a software that strikes with us as a Startup. Now we have an agile mindset, and we transfer actually quick to attempt new instruments and combine them into our knowledge ecosystem. This was one other level the place the information tradition of Atlan match very well with us.

How did you construction your analysis, and what have been the outcomes?

So we began a Proof of Idea with Atlan, and we actually preferred the way you carried out it. We had the assistance of Ravi, who is aware of loads about knowledge, and helped me with technical objects like integrations and bulk importing metadata from Excel information. We additionally had the assistance of Jill, and as a Spanish-speaking firm, I actually preferred that she launched a member of your crew who speaks Spanish that helped us with all of the workshops throughout the proof of idea.

We applied Atlan over a three-week part with our personal knowledge by operating 5 use circumstances with 21 actions in whole, which drove quite a lot of worth for us. We invited enterprise customers who use quite a lot of SQL queries and completely different knowledge instruments, and requested them to finish a survey, they usually rated Atlan extremely.

Throughout that proof of idea, we scored Atlan towards an analysis matrix of various parts, and the ultimate rating of Atlan was 4.8/5. We already knew that Atlan was a extremely good resolution for us, and at that second, we needed to decide to do the identical proof of idea together with your opponents, Alation and Secoda, or to decide to cease the analysis course of and begin the buying course of. So we made the choice to maneuver on with Atlan.

Atlan simply excels within the issues that have been necessary to us. It was simple to make use of, your connectors with Databricks and our knowledge ecosystem labored very well, and there was Atlan College, which I used as a part of the analysis and regarded nice for serving to with knowledge literacy.

We additionally talked with different Atlan clients, who spoke very well of you, and instructed us that your help crew was nice.

And that was it. With the three components of our proof of idea, the analysis with our energy customers, and the shopper reference, we knew Atlan could be nice. We expect Atlan has quite a lot of potential, and we wish to construct one thing of a neighborhood of Atlan customers right here, and to assist different clients select the proper software for his or her enterprise.

What stood out to you about Atlan, particularly?

First, it was Prukalpa’s route. I’ve adopted her for 3 years now, and I just like the imaginative and prescient of her, Varun, and the Atlan crew. I do know that it’s a brand new firm, however you’re rising exponentially, and I actually like your knowledge tradition.

Additionally, any time I looked for documentation or info over the net, I noticed one thing Atlan created. You could have a transparent rationalization of what Knowledge Mesh and Knowledge Contracts are. You clarify rising applied sciences nicely. I actually preferred that, as a result of sure, I’ve an Energetic Metadata Administration software, however I additionally wish to combine new instruments and ideas available in the market like Knowledge Contracts, and you’ll assist me with how to try this.

I additionally did some market analysis. I checked out Crunchbase, the place I noticed your funding and traders, and I regarded on the Forrester Wave the place you’re on high. I additionally checked out Gartner Peer Insights the place you’re actually well-rated, and the identical goes for G2.

So there was the imaginative and prescient out of your co-founders, all of the analysis, all of the sources, after which a few of your clients like Nasdaq and Plaid. I knew we made the proper determination, as a result of it was necessary to us that Atlan labored with clients that had related must us, and it gave us quite a lot of confidence within the software we selected.

However to be sincere, it’s that you’ve the most effective UI available in the market proper now. For me, a very powerful factor is that we selected a software that’s not just for tech individuals, however for everyone so we are able to democratize entry to knowledge.

Photograph by Jonas Leupe on Unsplash



Please enter your comment!
Please enter your name here