The Mongolian Meta
7 by deletionist | 1 comments on Hacker News.
Minggu, 31 Maret 2024
Anthony Davis wears throwback Nike Soldier 1 as tribute to LeBron James
Anthony Davis' Nike Soldier 1s lead Week 23 of NBA kicks.
from www.espn.com - TOP https://ift.tt/7O2WJCV
from www.espn.com - TOP https://ift.tt/7O2WJCV
Sabtu, 30 Maret 2024
Mulkey profile details coach's family, player rifts
The Washington Post published a profile of LSU coach Kim Mulkey on Saturday that paints the picture of a driven, loyal and complex woman who has alienated some family members and former players over the course of her career.
from www.espn.com - TOP https://ift.tt/YQ0KHca
from www.espn.com - TOP https://ift.tt/YQ0KHca
Undefeated, but Staley still 'worried every day'
South Carolina coach Dawn Staley has walked a fine line this season between instilling confidence in her players and being realistic about challenges the Gamecocks faced after losing six key players -- five of them starters -- from last year.
from www.espn.com - TOP https://ift.tt/JwsBc6H
from www.espn.com - TOP https://ift.tt/JwsBc6H
Jumat, 29 Maret 2024
Ricciardo's struggles being exacerbated by Tsunoda's speed
Daniel Ricciardo was supposed to spend 2024 preparing for a potential return to Red Bull. Instead, he's being outperformed by teammate Yuki Tsunoda.
from www.espn.com - TOP https://ift.tt/rUGa6Mw
from www.espn.com - TOP https://ift.tt/rUGa6Mw
Kamis, 28 Maret 2024
'You're the driver's eyes': The life of a NASCAR spotter
Spotters guide drivers through NASCAR's crowded fields, and ESPN helped do just that for Brad Perez at Circuit of the Americas in the Xfinity Series.
from www.espn.com - TOP https://ift.tt/IisrQ7N
from www.espn.com - TOP https://ift.tt/IisrQ7N
Rabu, 27 Maret 2024
Good day: Ice Cube, Big3 offer Caitlin Clark $5M
Iowa women's basketball star Caitlin Clark had been offered $5 million to play in Ice Cube's Big3 league, but it remains to be seen if that is feasible under current WNBA union rules.
from www.espn.com - TOP https://ift.tt/Qzr9DsG
from www.espn.com - TOP https://ift.tt/Qzr9DsG
Euro 2024 hosts Germany, freed from weight of expectation, are ready to fly
Euro 2024 hosts Germany have not won a knockout game in eight years. But wins over France and Netherlands show they are ready to enjoy the ride.
from www.espn.com - TOP https://ift.tt/SK6g9so
from www.espn.com - TOP https://ift.tt/SK6g9so
Ukraine hail Euros place as 'gift for our country'
The nation's qualification for the Euro 2024 finals has lifted a country suffering profound hardship.
from www.espn.com - TOP https://ift.tt/Zq5m2Pe
from www.espn.com - TOP https://ift.tt/Zq5m2Pe
Who are the prodigies allowing Barca to keep pace in LaLiga?
With spending limited, Barcelona have become reliant on homegrown players. Lucky for them, Yamal, Cubarsí & Co. are more than up for the challenge.
from www.espn.com - TOP https://ift.tt/uSnxk2W
from www.espn.com - TOP https://ift.tt/uSnxk2W
Selasa, 26 Maret 2024
NFL moves back trade deadline until after Week 9
NFL owners agreed to move the trade deadline back one week to the Tuesday after Week 9 and authorized a significant expansion to the league's replay assist program on Tuesday.
from www.espn.com - TOP https://ift.tt/Ww0vcZb
from www.espn.com - TOP https://ift.tt/Ww0vcZb
Senin, 25 Maret 2024
Bears GM 'surprised' by lesser interest in Fields
Bears GM Ryan Poles said he was "surprised" by the "smaller pool" of teams with interest in Justin Fields, and that he tried to do right by the QB by trading him to the Steelers.
from www.espn.com - TOP https://ift.tt/6gPd94E
from www.espn.com - TOP https://ift.tt/6gPd94E
Minggu, 24 Maret 2024
Follow live: Marquette takes on Colorado with spot in Sweet 16 on the line
null
from www.espn.com - TOP https://ift.tt/ZvNLV6t
from www.espn.com - TOP https://ift.tt/ZvNLV6t
Sabtu, 23 Maret 2024
Derby defeat at Man City piles more pressure on Man United manager
Man United boss Marc Skinner went into the derby hoping to reignite his team's European hopes. Instead, a 3-1 loss has increased the pressure on him.
from www.espn.com - TOP https://ift.tt/BcZ6zoq
from www.espn.com - TOP https://ift.tt/BcZ6zoq
Jumat, 22 Maret 2024
Women's college basketball betting soars ahead of March Madness
Doug Greenberg explores how sportsbooks have adapted their strategy for the sport.
from www.espn.com - TOP https://ift.tt/3HUVEiR
from www.espn.com - TOP https://ift.tt/3HUVEiR
Kamis, 21 Maret 2024
New Michigan DL coach resigns after OWI arrest
Defensive line coach Greg Scruggs, who was hired by Michigan on March 7, has resigned following his March 16 arrest for operating a vehicle while intoxicated.
from www.espn.com - TOP https://ift.tt/hPBpL7m
from www.espn.com - TOP https://ift.tt/hPBpL7m
Rabu, 20 Maret 2024
NCAA college wrestling championships preview: Storylines and wrestlers to watch
Can Carter Starocci and Aaron Brooks win a fourth title? The storylines and wrestlers we're watching in the NCAA Division I wrestling championships.
from www.espn.com - TOP https://ift.tt/XRinB4d
from www.espn.com - TOP https://ift.tt/XRinB4d
Selasa, 19 Maret 2024
What we learned at Indians Wells -- and what it means for the Miami Open
Alcaraz and Swiatek were back to their winning ways in Indian Wells -- will they repeat at this week's Miami Open? Or could someone like Gauff come out on top?
from www.espn.com - TOP https://ift.tt/KnP2WhX
from www.espn.com - TOP https://ift.tt/KnP2WhX
Senin, 18 Maret 2024
New top story on Hacker News: Parakeet: A Tiny LLM
Parakeet: A Tiny LLM
17 by razodactyl | 4 comments on Hacker News.
Hi all, https://ift.tt/avSCxde This post is more for gauging interest, I plan to release the entire end to end code including: - Dataset curation (including citations). - Model checkpoints. - Inference code. - Synthetic data generation. - etc. Parakeet is the name of a small language model I've designed from the ground up for the purpose of research. The challenge was to see how far I could push the limits of LLM tech. given a massively constrained environment. It was trained on a 3080 Ti and has a considerable amount more training to do but here are the results so far. Specs: - 18 layers / 18 heads - 8K context. - 1152 embedding dimension. - cl100k tokenizer (TikToken) - ALiBi (max I can train is 1200 tokens so this was crucial) - KV caching for improved inference. - Grouped Query Attention (2 layers per group / speeds up inference) - `min_p`: Cut-off low quality tokens. - Softmax1: https://ift.tt/DOdwVR1 - Not sure if this really made much of a difference / it's hard to train comparable models as compute resources are limited. - Sub 400M parameters (378M from memory) Edit: - Things I forgot to mention: NO RLHF / DPO, it's entirely dataset driven. - The model seems mostly harmless due to being trained only with synthetic data. - A side-effect of only being trained on synthetic data is that the model learns quite fast. - There's probably less than 2 weeks of actual training time in the model so far. - You don't need to start from scratch when altering model parameters. Weights can be copied/merged in and out of smaller/larger models. Why? - Curiosity got to me - I wanted to know what would happen if a model with a considerably small amount of parameters was bombarded with data. - There were many results showing these language models with room for more training but instead many are scaled up. - I wanted to see what happens if you just keep training them. References: - "./datasets/wikipedia-20220301.en.jsonl"), - "./datasets/euclaise_littletown.jsonl"), # https://ift.tt/A47OvVf - "./datasets/squad-v2.0-processed.jsonl"), - "./datasets/huggingface_ultrachat200k.jsonl"), # https://ift.tt/jzwOqTW - "./datasets/wizardlm_evol_instruct_v2_196k.jsonl"), # https://ift.tt/n96beRI - "./datasets/crumb_clean_instruct_440k.jsonl"), # https://ift.tt/6Y1gklw - Generate a story starting with the sentence "It was already late when they stepped out of the house". - "./datasets/openorca_4m.jsonl"), # https://ift.tt/9TJnbXS - "./datasets/databricks_dolly15k.jsonl"), # https://ift.tt/IeYZzjd - Common-sense reasoning. - "./datasets/teven_code_contests4m.jsonl"), # https://ift.tt/DCQVSZL - ['PYTHON', 'PYTHON3', 'JAVA', 'CPP'] - "./datasets/squad-v2.0-summaries.jsonl"), - "./datasets/google-boolq.jsonl"), - "./datasets/stingning_ultrachat.jsonl"), # https://ift.tt/YQpjC53 - "./datasets/wikimovies-train.jsonl"), - "./datasets/kunishou-databricks-dolly-15k-ja.jsonl"), - "./datasets/wizardlm_evol_instruct_70k.jsonl"), # https://ift.tt/9bVudJz - "./datasets/map_codefeedback.jsonl"), Sorry for bad formatting! ...continues in reply due to 4000 char. limit.
17 by razodactyl | 4 comments on Hacker News.
Hi all, https://ift.tt/avSCxde This post is more for gauging interest, I plan to release the entire end to end code including: - Dataset curation (including citations). - Model checkpoints. - Inference code. - Synthetic data generation. - etc. Parakeet is the name of a small language model I've designed from the ground up for the purpose of research. The challenge was to see how far I could push the limits of LLM tech. given a massively constrained environment. It was trained on a 3080 Ti and has a considerable amount more training to do but here are the results so far. Specs: - 18 layers / 18 heads - 8K context. - 1152 embedding dimension. - cl100k tokenizer (TikToken) - ALiBi (max I can train is 1200 tokens so this was crucial) - KV caching for improved inference. - Grouped Query Attention (2 layers per group / speeds up inference) - `min_p`: Cut-off low quality tokens. - Softmax1: https://ift.tt/DOdwVR1 - Not sure if this really made much of a difference / it's hard to train comparable models as compute resources are limited. - Sub 400M parameters (378M from memory) Edit: - Things I forgot to mention: NO RLHF / DPO, it's entirely dataset driven. - The model seems mostly harmless due to being trained only with synthetic data. - A side-effect of only being trained on synthetic data is that the model learns quite fast. - There's probably less than 2 weeks of actual training time in the model so far. - You don't need to start from scratch when altering model parameters. Weights can be copied/merged in and out of smaller/larger models. Why? - Curiosity got to me - I wanted to know what would happen if a model with a considerably small amount of parameters was bombarded with data. - There were many results showing these language models with room for more training but instead many are scaled up. - I wanted to see what happens if you just keep training them. References: - "./datasets/wikipedia-20220301.en.jsonl"), - "./datasets/euclaise_littletown.jsonl"), # https://ift.tt/A47OvVf - "./datasets/squad-v2.0-processed.jsonl"), - "./datasets/huggingface_ultrachat200k.jsonl"), # https://ift.tt/jzwOqTW - "./datasets/wizardlm_evol_instruct_v2_196k.jsonl"), # https://ift.tt/n96beRI - "./datasets/crumb_clean_instruct_440k.jsonl"), # https://ift.tt/6Y1gklw - Generate a story starting with the sentence "It was already late when they stepped out of the house". - "./datasets/openorca_4m.jsonl"), # https://ift.tt/9TJnbXS - "./datasets/databricks_dolly15k.jsonl"), # https://ift.tt/IeYZzjd - Common-sense reasoning. - "./datasets/teven_code_contests4m.jsonl"), # https://ift.tt/DCQVSZL - ['PYTHON', 'PYTHON3', 'JAVA', 'CPP'] - "./datasets/squad-v2.0-summaries.jsonl"), - "./datasets/google-boolq.jsonl"), - "./datasets/stingning_ultrachat.jsonl"), # https://ift.tt/YQpjC53 - "./datasets/wikimovies-train.jsonl"), - "./datasets/kunishou-databricks-dolly-15k-ja.jsonl"), - "./datasets/wizardlm_evol_instruct_70k.jsonl"), # https://ift.tt/9bVudJz - "./datasets/map_codefeedback.jsonl"), Sorry for bad formatting! ...continues in reply due to 4000 char. limit.
Duquense's Dambrot retiring after NCAA tourney
Duquesne head coach Keith Dambrot, who just led his team to the NCAA tournament, announced Monday he plans to retire at the end of the season.
from www.espn.com - TOP https://ift.tt/lRWKdxr
from www.espn.com - TOP https://ift.tt/lRWKdxr
Minggu, 17 Maret 2024
Pochettino's subs silence his critics as Chelsea reach Wembley again
Mauricio Pochettino will feel vindicated after two of his substitutes sent Chelsea to the FA Cup semifinals, but the pressure remains on the coach.
from www.espn.com - TOP https://ift.tt/U7xCNzl
from www.espn.com - TOP https://ift.tt/U7xCNzl
Sabtu, 16 Maret 2024
Yankees' Cole (elbow) won't throw for 3-4 weeks
Yankees ace Gerrit Cole says he has nerve irritation and edema in his throwing elbow and won't throw for three to four weeks.
from www.espn.com - TOP https://ift.tt/SidIVy0
from www.espn.com - TOP https://ift.tt/SidIVy0
Jumat, 15 Maret 2024
What do the first two rounds of a perfect draft look like?
Tristan H. Cockcroft and Eric Karabell reveal their ideal outcomes for the first two rounds of a 10-team draft from the point of view of any of the starting draft positions.
from www.espn.com - TOP https://ift.tt/rzQopCv
from www.espn.com - TOP https://ift.tt/rzQopCv
Kamis, 14 Maret 2024
Estimate: Over $2.7B in bets on NCAA tourneys
An estimated $2.72 billion could be wagered on the NCAA men's and women's basketball tournaments with American sportsbooks, according to an analysis released by the American Gaming Association.
from www.espn.com - TOP https://ift.tt/KX9WCmp
from www.espn.com - TOP https://ift.tt/KX9WCmp
Gov. blames Nebraska leadership for Alberts' exit
Gov. Jim Pillen is blaming the sudden departure of Nebraska athletic director Trev Alberts for the same job at Texas A&M on the school's inability to "appoint permanent leadership."
from www.espn.com - TOP https://ift.tt/lM3pJ4s
from www.espn.com - TOP https://ift.tt/lM3pJ4s
How PSV Eindhoven, with their U.S. contingent, returned to the top of the Eredivisie
PSV are closing on a first Dutch title since 2017-18. Here's how they have done it.
from www.espn.com - TOP https://ift.tt/EhdlHC1
from www.espn.com - TOP https://ift.tt/EhdlHC1
Rabu, 13 Maret 2024
Red Sox righty Giolito gets internal elbow brace
Boston Red Sox right-hander Lucas Giolito is expected to miss this season after his right ulnar collateral ligament was repaired with an internal brace.
from www.espn.com - TOP https://ift.tt/jG4lniK
from www.espn.com - TOP https://ift.tt/jG4lniK
Selasa, 12 Maret 2024
Ravens to sign ex-Titans RB Henry, sources say
Free agent running back Derrick Henry is signing a two-year, $16 million deal with the Ravens, sources told ESPN's Adam Schefter.
from www.espn.com - TOP https://ift.tt/P20cGD4
from www.espn.com - TOP https://ift.tt/P20cGD4
2024 NWSL season team-by-team preview: How are teams spending all that money coming in?
With the National Women's Soccer League returning to action this weekend, we break down where each of the 14 clubs stands and how close each is to winning the NWSL Championship.
from www.espn.com - TOP https://ift.tt/MIlOi7D
from www.espn.com - TOP https://ift.tt/MIlOi7D
Senin, 11 Maret 2024
Vikings to sign DE Greenard to $72M contract
The Vikings have agreed to a four-year, $72 million contract with Texans free agent defensive end.
from www.espn.com - TOP https://ift.tt/gyRVXTQ
from www.espn.com - TOP https://ift.tt/gyRVXTQ
Minggu, 10 Maret 2024
Eagles' Cox, 6-time Pro Bowler, retires from NFL
Six-time Pro Bowl Philadelphia Eagles defensive tackle Fletcher Cox announced Sunday he is retiring.
from www.espn.com - TOP https://ift.tt/IxlBabt
from www.espn.com - TOP https://ift.tt/IxlBabt
Serie A game marred as coach head-butts striker
Lecce coach Roberto D'Aversa headbutted Hellas Verona striker Thomas Henry following a heated matchup between the two teams.
from www.espn.com - TOP https://ift.tt/nyV2pGL
from www.espn.com - TOP https://ift.tt/nyV2pGL
Iowa star Clark headlines Wooden Award top 15
Caitlin Clark headlines the 15-player national ballot for the John R. Wooden Award.
from www.espn.com - TOP https://ift.tt/xPEr80e
from www.espn.com - TOP https://ift.tt/xPEr80e
Sabtu, 09 Maret 2024
Playoff watch: Resetting the races following a busy trade deadline week
After a flurry of deals, it's the final push. Here are full playoff projections, updated lottery standings and more.
from www.espn.com - TOP https://ift.tt/rgd5Mos
from www.espn.com - TOP https://ift.tt/rgd5Mos
Jumat, 08 Maret 2024
NAIA team in tournament despite school closure
Antelope Valley College is being forced to shut down, leaving the men's and women's basketball team without a home to play in the NAIA tournament, despite raising the money to pay for the postseason tournament.
from www.espn.com - TOP https://ift.tt/EPxnq82
from www.espn.com - TOP https://ift.tt/EPxnq82
Kamis, 07 Maret 2024
Sources: Red Bull suspends Horner accuser
The employee who accused Red Bull F1 team boss Christian Horner of inappropriate behaviour has been suspended by the company, sources with knowledge of the situation confirmed to ESPN.
from www.espn.com - TOP https://ift.tt/M2CU81X
from www.espn.com - TOP https://ift.tt/M2CU81X
Sweden's Olsson has multiple blood clots in brain
Sweden midfielder Kristoffer Olsson is suffering from multiple small blood clots on both sides of his brain as a result of an extremely rare inflammatory condition in his brain vessels.
from www.espn.com - TOP https://ift.tt/BZ3L42s
from www.espn.com - TOP https://ift.tt/BZ3L42s
Rabu, 06 Maret 2024
Selasa, 05 Maret 2024
2024 NFL franchise tag tracker: Panthers tag Brian Burns
The Panthers placed the franchise tag on linebacker Brian Burns ahead of the 4 p.m. ET deadline Tuesday.
from www.espn.com - TOP https://ift.tt/XscVKYU
from www.espn.com - TOP https://ift.tt/XscVKYU
Senin, 04 Maret 2024
Eckroat gets first career PGA Tour win, $1.62M
Austin Eckroat, 25, earned his first PGA Tour victory Monday, shooting 17-under-267 to win the Cognizant Classic, earning $1.62 million, tour status for two years and a trip to the Masters for the first time.
from www.espn.com - TOP https://ift.tt/0Axgisz
from www.espn.com - TOP https://ift.tt/0Axgisz
College baseball top 25 rankings, plus players to watch
The latest top 25 rankings, plus the players we're watching in March.
from www.espn.com - TOP https://ift.tt/XZShn1K
from www.espn.com - TOP https://ift.tt/XZShn1K
Minggu, 03 Maret 2024
Follow live: City host United on Manchester derby day
null
from www.espn.com - TOP https://ift.tt/YEGzrL0
from www.espn.com - TOP https://ift.tt/YEGzrL0
Sabtu, 02 Maret 2024
Sources: Mbappé holds talks with PSG coach
Paris Saint-Germain forward Kylian Mbappé met with manager Luis Enrique at the club's training centre on Saturday to address tension stemming from recent substitutions, sources have told ESPN.
from www.espn.com - TOP https://ift.tt/rxEXd13
from www.espn.com - TOP https://ift.tt/rxEXd13
Jumat, 01 Maret 2024
Penix says he's healthy, set to be franchise QB
Washington quarterback Michael Penix says he has proven he is healthy and is ready to be an NFL franchise QB.
from www.espn.com - TOP https://ift.tt/Ngxzfs7
from www.espn.com - TOP https://ift.tt/Ngxzfs7
Langganan:
Postingan (Atom)